-- Logs begin at Tue 2022-08-23 23:41:33 UTC, end at Wed 2022-08-24 00:41:21 UTC. -- Aug 24 00:14:14.652658 dv-osbrick-786733-9-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 00:14:14.665380 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 00:14:14 2022] *** Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: nodename: dv-osbrick-786733-9-ceph Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: machine: x86_64 Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: clock source: unix Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: pcre jit disabled Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: detected number of CPU cores: 4 Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: current working directory: / Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: detected binary path: /usr/bin/uwsgi-core Aug 24 00:14:14.667461 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: your processes number limit is 47680 Aug 24 00:14:14.668097 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: your memory page size is 4096 bytes Aug 24 00:14:14.668097 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: detected max file descriptor number: 2048 Aug 24 00:14:14.668097 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: lock engine: pthread robust mutexes Aug 24 00:14:14.668097 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: thunder lock: enabled Aug 24 00:14:14.668097 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 00:14:14.668097 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 00:14:14.713924 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: Python main interpreter initialized at 0x557a75f9d9c0 Aug 24 00:14:14.713924 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: python threads support enabled Aug 24 00:14:14.713924 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: your server socket listen backlog is limited to 100 connections Aug 24 00:14:14.713924 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: your mercy for graceful operations on workers is 90 seconds Aug 24 00:14:14.714284 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 00:14:14.714360 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: *** Operational MODE: preforking *** Aug 24 00:14:14.714591 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: *** uWSGI is running in multiple interpreter mode *** Aug 24 00:14:14.714591 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: spawned uWSGI master process (pid: 94689) Aug 24 00:14:14.714833 dv-osbrick-786733-9-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 24 00:14:14.718051 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: spawned uWSGI worker 1 (pid: 94701, cores: 1) Aug 24 00:14:14.718051 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: spawned uWSGI worker 2 (pid: 94702, cores: 1) Aug 24 00:14:14.718051 dv-osbrick-786733-9-ceph devstack@keystone.service[94689]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 00:14:19.381144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 00:14:19.381144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: from cryptography.utils import int_from_bytes Aug 24 00:14:19.382036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 00:14:19.382036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: from cryptography.utils import int_from_bytes Aug 24 00:14:19.382406 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 00:14:19.382406 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: from cryptography.utils import int_from_bytes Aug 24 00:14:19.382862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 00:14:19.382862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: from cryptography.utils import int_from_bytes Aug 24 00:14:19.433561 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 00:14:19.433774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 00:14:19.433932 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] command line args: [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 00:14:19.434200 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 00:14:19.434378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ================================================================================ {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 00:14:19.434633 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] admin_token = **** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.434882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] config_dir = [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.435068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.435249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] config_source = [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.435427 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] debug = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.435628 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.436027 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.436208 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.436462 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.436709 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.436940 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] list_limit = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.437124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] log_config_append = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.437300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.437477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] log_dir = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.437655 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] log_file = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.437869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 00:14:19.437959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.438089 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 00:14:19.438222 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.438305 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] command line args: [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 00:14:19.438386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.438542 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 00:14:19.438633 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.438713 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ================================================================================ {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 00:14:19.438774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.438934 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439053 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] admin_token = **** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] config_dir = [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439463 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] config_source = [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439641 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439763 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] debug = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439875 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.439957 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.440058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.440200 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.440279 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.440385 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.440523 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.440639 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.440768 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.440893 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441044 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441177 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] list_limit = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] log_config_append = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441482 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] log_dir = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441763 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] publish_errors = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441845 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] log_file = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.441922 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442550 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442629 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442787 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442912 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.442999 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.443640 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] standard_threads = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.443720 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.443895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444122 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444434 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] use_journal = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444613 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] use_json = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444792 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] use_stderr = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444898 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.444977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] use_syslog = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.445135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.445223 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.445388 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.445468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.445640 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.445725 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.445900 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.445986 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.446142 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.446390 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.446474 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.446573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] publish_errors = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.446718 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.446800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.446871 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.447030 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.447115 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.447195 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.447321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.447446 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.447568 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.447684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.447837 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.447954 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] standard_threads = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.448070 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.448193 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.448305 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.448441 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.448544 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.448649 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.448775 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.448885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] use_journal = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.448985 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] use_json = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.449068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.449141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] use_stderr = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.449249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.449329 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] use_syslog = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.449504 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.449583 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:14:19.449757 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.449835 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450000 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450078 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450568 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450739 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.450983 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.451062 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.451239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.451322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.451483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.451569 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.451736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.451899 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452010 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452097 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452482 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452561 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452731 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452810 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.452962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453192 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453276 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453440 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453525 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453680 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453757 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453914 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.453997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.454163 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.454250 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.454395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.454514 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.454640 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.454719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.454863 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.454950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.455092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.455171 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.455322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.455446 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.455552 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.455639 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.455781 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.455884 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456042 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456386 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456521 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456600 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456757 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456835 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.456987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.457077 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.457223 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.457303 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.457459 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.457543 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.457709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.457859 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.457934 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.458003 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.458158 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.458243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.458400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.458486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.458636 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.459347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.459435 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.459512 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.459657 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.459779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.459915 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.459994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.460153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.460258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.460389 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.460478 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.460624 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.460710 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.460856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.460945 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.461109 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.461195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.461345 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.461422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.461575 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.461664 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.461808 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.461895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.462042 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.462120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.462281 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.462418 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.462537 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.462623 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.462772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.462852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463016 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463096 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463253 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463339 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463491 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463729 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463808 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.463992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.464070 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.464229 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.464311 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.464464 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.464542 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.464710 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.464793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.464949 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465028 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465182 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465266 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465421 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465744 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465895 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.465974 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.466139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.466218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.466380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.466468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.466624 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.466703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.466880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.466958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.467216 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.467387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.467467 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.467623 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.467700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.467874 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.467970 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.468111 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.468191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.468348 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.468434 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.468579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.468660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.468815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.468900 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469283 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469519 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469758 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469845 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.469991 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.470064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.470228 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.470308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.470484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.470571 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] auth.external = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471408 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471601 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471601 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471792 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.471918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472017 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472224 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] auth.password = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472224 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] auth.token = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472845 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.472845 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473229 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473326 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473420 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473516 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.473964 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] credential.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.474065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.474204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.474335 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.475092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.475347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.475461 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.475588 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.475730 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.475890 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.476001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.476112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.476246 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] auth.external = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.476353 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.476492 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.476598 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.476791 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.476939 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477049 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477290 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] auth.password = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477490 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] auth.token = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477601 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.477949 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.478062 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.478208 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.478322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.478450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.478568 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] federation.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.478707 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.478815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.478959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.479077 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.479183 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.479286 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.479426 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.479536 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] credential.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.479676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.479791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.479939 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.480047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.480195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.480315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.480433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.480556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.480665 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.480766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.480911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.481017 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.481649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.481728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.481801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.481872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.481952 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482026 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482168 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482317 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482841 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.482921 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.483082 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.483164 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.483334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.483415 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] federation.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.483588 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.483677 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.483880 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.483966 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.484092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.484176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.484297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.484455 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.484533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.484605 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.484781 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.484861 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.485029 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.485118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.485284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.485364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.485530 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.485611 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.485775 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.485862 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486028 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486268 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486348 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486741 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486822 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.486972 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.487052 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.487208 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.487296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.487450 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.487531 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.487688 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.487766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.487956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488050 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488275 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488444 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488770 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488918 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.488997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.489155 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.489234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.489399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.489486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.489629 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.489710 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.489868 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.489998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.490779 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.490882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.491048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.491129 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.491288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.491390 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.491538 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.491627 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.491779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.491890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.492045 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.492125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.492297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.492390 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.492548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.492630 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.492782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.492862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493013 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493264 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493748 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493835 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.493984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.494063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.494222 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.494305 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.494453 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.494541 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.494694 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.494775 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.494951 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.495029 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.495180 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.495261 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.495422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.495507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.495659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.495740 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.495925 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496012 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496390 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496470 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496862 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.496942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.497099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.497178 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.497328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.497410 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.497573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.497652 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.497806 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.497885 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.498054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.498135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.498303 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.498383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.498545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.498631 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.498776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.498858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499093 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499250 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499329 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499483 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499720 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.499988 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.500070 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.500237 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.500319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.500486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.500565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.500722 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.500801 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.500967 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501049 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501198 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501277 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501437 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501515 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501754 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501912 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.501993 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.502143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.502221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.502391 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.502471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.502634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.502714 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.502867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.502947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.503105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.503187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.503348 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] resource.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.503428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.503579 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.503657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.503857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.503941 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.504094 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.504174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.504335 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.504414 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.504581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.504663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.504815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.504893 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.505062 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.505142 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.505301 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.505382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.505570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.505708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.505818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] role.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.505991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.506079 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] role.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.506287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.506366 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.506536 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.506617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.506787 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.506877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.507036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.507116 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.507285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.507365 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.507533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.507621 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.507780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.507878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.508043 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.508122 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.508289 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.508453 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.508530 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.508599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] resource.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.508753 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.508833 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509000 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509083 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509246 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509747 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.509989 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.510147 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.510227 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.510398 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.510487 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.510647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.510728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.510895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.510975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] role.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.511143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.511232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] role.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.511380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.511460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.511633 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.511712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.511908 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512382 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512614 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.512929 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.513101 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.513181 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.513359 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.513448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.513601 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.513688 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.513836 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.513915 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.514074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.514164 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.514307 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.514387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.514545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] token.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.514625 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.514785 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.514972 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.515054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.515215 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.515295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.515471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.515560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.515725 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.515806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.515985 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.516068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.516229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.516322 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.516473 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.516554 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.516721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.516802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.516959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517197 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517434 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517760 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517910 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.517990 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.518142 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.518221 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.518386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.518474 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.518658 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.518738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.518904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.518985 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.connection = **** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.519158 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.519289 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.519401 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.519502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.519635 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.519715 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] token.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.519902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.519985 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.520142 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.520234 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.520381 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.520461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.520617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.520697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.520853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.520943 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.521097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.521194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.521506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.521598 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.521759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.521850 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522015 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522339 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522496 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522587 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522735 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522814 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.522967 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.523047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.523211 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.523294 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.523449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.523529 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.523621 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 00:14:19.523701 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.524011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.524282 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.connection = **** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.524534 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.524787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.525033 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.525280 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.525521 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.525765 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.526006 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.526249 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.526502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.526746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.526997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.527241 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.527498 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.527741 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.528017 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.528256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.528503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.528746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:14:19.528920 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 00:14:19.553700 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.553930 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.554157 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.555324 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.555564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.555796 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.562438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.564339 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.591887 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.592140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.592819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.593053 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.644959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.645557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.694416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.694642 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.694889 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.695129 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.762015 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.762245 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.762394 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.762487 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.762627 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.762716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.762849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.762962 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.763092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.763223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.763584 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.763799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.788573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.788793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789018 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789109 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789324 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789463 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789551 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789678 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.789891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.790074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.790293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.790504 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.801784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.801952 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.814904 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.815140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.815379 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.815644 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.815897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.816115 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.816327 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.817060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.817292 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.817513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.817728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.817938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.818262 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.818507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:14:19.833236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.833446 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 00:14:19.834329 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.834422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.834562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 00:14:19.834698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 00:14:19.834878 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.835021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.835171 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.835300 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 00:14:19.835426 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.835554 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.835679 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.835812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.835976 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.836106 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.844963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.845239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.845509 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.845651 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.845792 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.845921 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.846144 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.846430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.853297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.853815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.856172 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.856458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.856744 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.856885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.857031 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.857163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.857293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.857422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.857554 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.857691 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.857821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.857950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.858080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.858209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.858346 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.858486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.858617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.858745 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.858875 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.859013 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.859194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.859465 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.882106 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.882978 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.883567 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.883874 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.884459 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.884743 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.888419 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.888785 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.889075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.889237 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.889808 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.896867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.897102 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.897690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.897981 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.902008 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.902302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.902587 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.902891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.903177 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.903456 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.903738 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.904025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.904131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.904354 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.904720 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.905015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.905316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.905708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.905995 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.906277 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.922765 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.923043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.923514 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.923801 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.926882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.927676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.930049 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.930336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.930864 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.931184 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.934677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.935539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.937783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.938702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.940854 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.941160 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.941443 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.941723 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.941819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.941998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.942082 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.942376 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.942459 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.942665 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.942948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.943272 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.958144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.958429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.959290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.959583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.959953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.960250 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.960524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.966236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.967531 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.968007 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.968288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.969156 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.969438 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.970893 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.971190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.971477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.971909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.972215 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.972312 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.972519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.972816 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.973102 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.973394 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.984157 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.984442 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.984724 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.985008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.985293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.985394 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:19.985573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.985674 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.985851 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.985942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.986189 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.986476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.986755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:19.987033 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.001202 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.002401 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.004097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.005367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.007603 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.008784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.009047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.010343 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.010675 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.010958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.011241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.011814 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.012123 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.012419 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.017760 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.018735 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.019232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.020350 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.022836 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.023123 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.023409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.023696 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.023793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.024076 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.024385 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.024675 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.032581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.032691 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.032872 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.032956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.033153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.033245 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.040023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.040134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:14:20.040395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.040478 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.040680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.040763 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.040955 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.041040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.041232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.041315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.041502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.041585 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.041785 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.041868 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.042056 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.042138 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.042331 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.042599 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.042866 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.043126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.043318 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.043453 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.043620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.043703 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.043941 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.044238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.044530 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.044808 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:14:20.078169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a75f9d9c0 pid: 94701 (default app) Aug 24 00:14:20.078755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a75f9d9c0 pid: 94702 (default app) Aug 24 00:14:20.081680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043c1f-a831-417c-b6f6-b07552fc3eae None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:20.081969 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043c1f-a831-417c-b6f6-b07552fc3eae None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:20.082242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043c1f-a831-417c-b6f6-b07552fc3eae None None] PATH_INFO: `/v3` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:20.087275 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Wed Aug 24 00:14:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:27.264204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979606b-38bf-48ec-b1d6-36e8ce8c9b5d None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:27.264769 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979606b-38bf-48ec-b1d6-36e8ce8c9b5d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:27.264769 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979606b-38bf-48ec-b1d6-36e8ce8c9b5d None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:27.269221 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:27.274863 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:27.275352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:27.275449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:27.352419 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: INFO dbcounter [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] Registered counter for database keystone Aug 24 00:14:27.372206 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG oslo_db.sqlalchemy.engines [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 00:14:27.378378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writer thread running {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 00:14:27.560230 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG passlib.handlers.bcrypt [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=94701) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 00:14:27.560649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG passlib.handlers.bcrypt [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94701) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 00:14:27.614543 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:27.616643 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:27.745453 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 00:14:28.285091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979606b-38bf-48ec-b1d6-36e8ce8c9b5d None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:28.360376 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: INFO dbcounter [None req-b979606b-38bf-48ec-b1d6-36e8ce8c9b5d None None] Registered counter for database keystone Aug 24 00:14:28.382145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG oslo_db.sqlalchemy.engines [None req-b979606b-38bf-48ec-b1d6-36e8ce8c9b5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 00:14:28.388324 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writer thread running {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 00:14:28.507323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979606b-38bf-48ec-b1d6-36e8ce8c9b5d None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:28.511597 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a63603-1934-4ed1-9c5a-7a437defb039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:28.512257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63603-1934-4ed1-9c5a-7a437defb039 admin admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.512536 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63603-1934-4ed1-9c5a-7a437defb039 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.512805 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63603-1934-4ed1-9c5a-7a437defb039 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.521711 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a63603-1934-4ed1-9c5a-7a437defb039 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:28.573147 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-16a63603-1934-4ed1-9c5a-7a437defb039 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 00:14:28.573492 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a63603-1934-4ed1-9c5a-7a437defb039 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:28.582980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Wed Aug 24 00:14:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 00:14:28.589675 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:28.606287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd203-5c0b-4d98-85f9-52b207e2c2e5 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:28.610720 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640f526-6973-457e-9d20-e4cf5357d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:28.611819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640f526-6973-457e-9d20-e4cf5357d6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.612130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640f526-6973-457e-9d20-e4cf5357d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.612404 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640f526-6973-457e-9d20-e4cf5357d6c1 admin admin] PATH_INFO: `/v3/projects/b165c34800e2494a8f309a6e802bd8dd` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.613839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640f526-6973-457e-9d20-e4cf5357d6c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b165c34800e2494a8f309a6e802bd8dd)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:28.664866 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e640f526-6973-457e-9d20-e4cf5357d6c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 00:14:28.665206 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640f526-6973-457e-9d20-e4cf5357d6c1 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:28.670125 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Wed Aug 24 00:14:28 2022] GET /identity/v3/projects/b165c34800e2494a8f309a6e802bd8dd => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:30.851334 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577e62-f9f2-4baf-b005-0d110e4bf5f8 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.851890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577e62-f9f2-4baf-b005-0d110e4bf5f8 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.851890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577e62-f9f2-4baf-b005-0d110e4bf5f8 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.856022 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:30.861405 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94445f-21e8-4b83-8868-cbd55cbfc755 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.861822 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94445f-21e8-4b83-8868-cbd55cbfc755 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.861963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94445f-21e8-4b83-8868-cbd55cbfc755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.882684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-ed94445f-21e8-4b83-8868-cbd55cbfc755 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:30.884256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-ed94445f-21e8-4b83-8868-cbd55cbfc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:30.892089 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 00:14:31.221139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47577e62-f9f2-4baf-b005-0d110e4bf5f8 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.233856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47577e62-f9f2-4baf-b005-0d110e4bf5f8 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.238000 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b2c8d-1219-481e-a139-15d8c810fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.238588 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2c8d-1219-481e-a139-15d8c810fb95 admin admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.238864 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2c8d-1219-481e-a139-15d8c810fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.239133 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2c8d-1219-481e-a139-15d8c810fb95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.246787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b2c8d-1219-481e-a139-15d8c810fb95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.248583 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b2c8d-1219-481e-a139-15d8c810fb95 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.258505 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 00:14:31.264856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94445f-21e8-4b83-8868-cbd55cbfc755 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.275579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94445f-21e8-4b83-8868-cbd55cbfc755 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.280018 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9936c-30be-45c6-8ff1-a5d4f66767df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.280645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9936c-30be-45c6-8ff1-a5d4f66767df admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.280932 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9936c-30be-45c6-8ff1-a5d4f66767df admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.281207 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9936c-30be-45c6-8ff1-a5d4f66767df admin admin] PATH_INFO: `/v3/users/d01b5a2be47a4a399c58e609908b5598` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.282524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9936c-30be-45c6-8ff1-a5d4f66767df admin admin] RBAC: Authorizing `identity:get_user(user_id=d01b5a2be47a4a399c58e609908b5598)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.284444 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9936c-30be-45c6-8ff1-a5d4f66767df admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.286003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/users/d01b5a2be47a4a399c58e609908b5598 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:33.563911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43e0c-8221-49f4-a8fd-c57c42f84b26 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:33.564453 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43e0c-8221-49f4-a8fd-c57c42f84b26 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:33.564453 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43e0c-8221-49f4-a8fd-c57c42f84b26 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:33.565784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:33.571521 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4497c-b246-4ec5-b9ec-97fa34d97a11 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:33.571986 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4497c-b246-4ec5-b9ec-97fa34d97a11 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:33.572115 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4497c-b246-4ec5-b9ec-97fa34d97a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:33.590480 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-bcf4497c-b246-4ec5-b9ec-97fa34d97a11 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:33.591666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-bcf4497c-b246-4ec5-b9ec-97fa34d97a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:33.593761 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d696d7d-656d-4efd-8223-0d50267fdec3 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:33.594046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d696d7d-656d-4efd-8223-0d50267fdec3 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:33.594327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d696d7d-656d-4efd-8223-0d50267fdec3 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:33.595613 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:33.601237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:33.601523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:33.601800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:33.644796 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG passlib.handlers.bcrypt [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=94702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 00:14:33.645230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG passlib.handlers.bcrypt [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 00:14:33.691880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:33.694307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:33.785652 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:33.807569 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:34.107468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4497c-b246-4ec5-b9ec-97fa34d97a11 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.132396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.137551 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.218352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4497c-b246-4ec5-b9ec-97fa34d97a11 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.247486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158705c0-82ba-42e8-9524-318f86f5d213 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.249755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.252777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0ca17-f4d3-4094-b075-826100c4f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.253428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ca17-f4d3-4094-b075-826100c4f696 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.253706 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ca17-f4d3-4094-b075-826100c4f696 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.253978 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ca17-f4d3-4094-b075-826100c4f696 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.268027 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0ca17-f4d3-4094-b075-826100c4f696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-7dd0ca17-f4d3-4094-b075-826100c4f696 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:34.277319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:34.278285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:14:34.279100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:34.284126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0ca17-f4d3-4094-b075-826100c4f696 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.286981 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac18213-16d5-46e1-8f9e-32ef8833d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.287848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac18213-16d5-46e1-8f9e-32ef8833d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.288172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac18213-16d5-46e1-8f9e-32ef8833d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.288460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac18213-16d5-46e1-8f9e-32ef8833d5e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.357115 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac18213-16d5-46e1-8f9e-32ef8833d5e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:34.358712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac18213-16d5-46e1-8f9e-32ef8833d5e3 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:34.365360 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.383661 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0ca17-f4d3-4094-b075-826100c4f696 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.418249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.418850 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.419123 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.419404 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.420100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:34.420401 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:34.422073 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:34.433661 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:34.439382 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.459953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 00:14:34.465502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac18213-16d5-46e1-8f9e-32ef8833d5e3 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.468279 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.545889 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3618-7408-44b8-992f-9cf90a49e800 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.568186 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac18213-16d5-46e1-8f9e-32ef8833d5e3 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.582092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b640b-8691-421b-bdbc-37defaa1fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.582718 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b640b-8691-421b-bdbc-37defaa1fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.583227 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b640b-8691-421b-bdbc-37defaa1fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.583503 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b640b-8691-421b-bdbc-37defaa1fdb3 None admin] PATH_INFO: `/v3/users/d01b5a2be47a4a399c58e609908b5598` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.584693 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b640b-8691-421b-bdbc-37defaa1fdb3 None admin] RBAC: Authorizing `identity:get_user(user_id=d01b5a2be47a4a399c58e609908b5598)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:34.586188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b640b-8691-421b-bdbc-37defaa1fdb3 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:34.587737 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/users/d01b5a2be47a4a399c58e609908b5598 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:34.593187 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b640b-8691-421b-bdbc-37defaa1fdb3 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.603091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.603968 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.604257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.604532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.607618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.623489 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:34.624917 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:34.643257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:34.644243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:34.645057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:34.645057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:34.645057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:14:34.645057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:34.650855 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.697575 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b640b-8691-421b-bdbc-37defaa1fdb3 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.708676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.733705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d1c46-992b-4617-b907-7dc003bf755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.734366 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1c46-992b-4617-b907-7dc003bf755f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.734648 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1c46-992b-4617-b907-7dc003bf755f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.734923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1c46-992b-4617-b907-7dc003bf755f None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.736217 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d1c46-992b-4617-b907-7dc003bf755f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:34.737718 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d1c46-992b-4617-b907-7dc003bf755f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:34.739352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:34.745528 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d1c46-992b-4617-b907-7dc003bf755f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.834776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.854670 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d1c46-992b-4617-b907-7dc003bf755f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.864114 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c14e8-f548-43ef-b77f-81652072ec34 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.889314 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a1614-58f8-46d6-81c7-46edb5c93ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.889856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1614-58f8-46d6-81c7-46edb5c93ca8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.890138 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1614-58f8-46d6-81c7-46edb5c93ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.890412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1614-58f8-46d6-81c7-46edb5c93ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.891133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a1614-58f8-46d6-81c7-46edb5c93ca8 None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.domain.id=default, user.id=d01b5a2be47a4a399c58e609908b5598) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:34.891446 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a1614-58f8-46d6-81c7-46edb5c93ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:34.892933 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a1614-58f8-46d6-81c7-46edb5c93ca8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:34.899716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a63d27-0933-4a5a-a681-f2cd6bd1a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.900364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a63d27-0933-4a5a-a681-f2cd6bd1a611 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.900645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a63d27-0933-4a5a-a681-f2cd6bd1a611 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.900844 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 11/20] 10.222.0.70 () {56 vars in 1322 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/role_assignments?user.id=d01b5a2be47a4a399c58e609908b5598&scope.domain.id=default&role.id=952eea31fada4104858d315ac0f1296a => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:34.901213 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a63d27-0933-4a5a-a681-f2cd6bd1a611 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.901871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a63d27-0933-4a5a-a681-f2cd6bd1a611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:34.902178 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a63d27-0933-4a5a-a681-f2cd6bd1a611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:34.903564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a63d27-0933-4a5a-a681-f2cd6bd1a611 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:34.924366 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 10/21] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:37.334342 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136dceb-5dfb-4908-a3af-5cd66d988865 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.334867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136dceb-5dfb-4908-a3af-5cd66d988865 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.334867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136dceb-5dfb-4908-a3af-5cd66d988865 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.336532 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 12/22] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:37.341446 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59c944-c3c6-4b93-af5b-2566b065313d None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.341837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59c944-c3c6-4b93-af5b-2566b065313d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.342016 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59c944-c3c6-4b93-af5b-2566b065313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.368310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-cb59c944-c3c6-4b93-af5b-2566b065313d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:37.369529 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-cb59c944-c3c6-4b93-af5b-2566b065313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:37.463129 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 11/23] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:37.796677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e7b1-c8f4-4e9e-b82e-91c652084111 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.797027 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e7b1-c8f4-4e9e-b82e-91c652084111 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.797235 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e7b1-c8f4-4e9e-b82e-91c652084111 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.798574 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:37.804564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f645f4-c6ab-47db-947a-d9e890fee30e None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.804874 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f645f4-c6ab-47db-947a-d9e890fee30e None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.805131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f645f4-c6ab-47db-947a-d9e890fee30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.816359 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9adc-091d-4e8a-99f3-fc1d7a2474dd None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.816652 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9adc-091d-4e8a-99f3-fc1d7a2474dd None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.816964 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9adc-091d-4e8a-99f3-fc1d7a2474dd None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.819129 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 14/25] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:37.835985 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0763-7d3b-4437-9474-00fab4fdf318 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.836346 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0763-7d3b-4437-9474-00fab4fdf318 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.836536 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0763-7d3b-4437-9474-00fab4fdf318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.840618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f1f645f4-c6ab-47db-947a-d9e890fee30e None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:37.844956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f1f645f4-c6ab-47db-947a-d9e890fee30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:37.871363 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-aabf0763-7d3b-4437-9474-00fab4fdf318 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:37.872619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-aabf0763-7d3b-4437-9474-00fab4fdf318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:37.930104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.002197 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 12/26] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:38.046153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 15/27] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:38.120728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6fd0-7d40-473f-92d5-3f5683ac3af9 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.121050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6fd0-7d40-473f-92d5-3f5683ac3af9 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.121232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6fd0-7d40-473f-92d5-3f5683ac3af9 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.121770 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf0763-7d3b-4437-9474-00fab4fdf318 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.122550 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 13/28] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:38.127872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f62c7-d5b5-4015-913c-1d8ff64b9a41 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.128163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f62c7-d5b5-4015-913c-1d8ff64b9a41 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.128441 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f62c7-d5b5-4015-913c-1d8ff64b9a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.161411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-447f62c7-d5b5-4015-913c-1d8ff64b9a41 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:38.162775 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-447f62c7-d5b5-4015-913c-1d8ff64b9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:38.262584 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.322928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 14/29] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:38.325599 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf0763-7d3b-4437-9474-00fab4fdf318 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.388869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b71f9-e986-4ad3-b1e5-cf349d6a46bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.389496 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b71f9-e986-4ad3-b1e5-cf349d6a46bc None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.389722 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b71f9-e986-4ad3-b1e5-cf349d6a46bc None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.389948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b71f9-e986-4ad3-b1e5-cf349d6a46bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.410503 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b71f9-e986-4ad3-b1e5-cf349d6a46bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-583b71f9-e986-4ad3-b1e5-cf349d6a46bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:38.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:38.416247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:14:38.417384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 16/30] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:38.422771 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f62c7-d5b5-4015-913c-1d8ff64b9a41 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.524733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b71f9-e986-4ad3-b1e5-cf349d6a46bc None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.635416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f62c7-d5b5-4015-913c-1d8ff64b9a41 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.645069 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.702907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.703522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.703879 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.704157 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.704829 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:38.705129 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.706523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.735618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b71f9-e986-4ad3-b1e5-cf349d6a46bc None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.736265 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 15/31] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:38.737452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.779209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.779879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.780462 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.781345 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.783865 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.798072 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.800664 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:38.826232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:38.827126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:38.828072 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:38.828072 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:38.828072 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:14:38.829480 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 17/32] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:38.831149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.858845 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ede61d-9145-4281-9163-be55fdb6dcc8 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.895543 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae8ae7-9faf-4b3d-831f-46526262585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.896847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae8ae7-9faf-4b3d-831f-46526262585d None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.897228 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae8ae7-9faf-4b3d-831f-46526262585d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.897603 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae8ae7-9faf-4b3d-831f-46526262585d None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.898370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae8ae7-9faf-4b3d-831f-46526262585d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.899867 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae8ae7-9faf-4b3d-831f-46526262585d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.962110 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25664f94-7be5-4960-a5da-b5406c1024d8 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.000782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363bb0b-ea25-4183-a1f2-38eb8d7c31ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.001653 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363bb0b-ea25-4183-a1f2-38eb8d7c31ec None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.002138 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363bb0b-ea25-4183-a1f2-38eb8d7c31ec None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.002545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363bb0b-ea25-4183-a1f2-38eb8d7c31ec None admin] PATH_INFO: `/v3/users/d01b5a2be47a4a399c58e609908b5598` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.003895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363bb0b-ea25-4183-a1f2-38eb8d7c31ec None admin] RBAC: Authorizing `identity:get_user(user_id=d01b5a2be47a4a399c58e609908b5598)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.006166 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363bb0b-ea25-4183-a1f2-38eb8d7c31ec None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.007998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 18/33] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/users/d01b5a2be47a4a399c58e609908b5598 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:39.008925 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363bb0b-ea25-4183-a1f2-38eb8d7c31ec None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.073609 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:39.076704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 16/34] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 24 00:14:38 2022] POST /identity/v3/roles => generated 219 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:39.077997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae8ae7-9faf-4b3d-831f-46526262585d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.112997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:39.138632 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363bb0b-ea25-4183-a1f2-38eb8d7c31ec None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.178992 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe4e8-8965-4962-8121-dee80516a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.179897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe4e8-8965-4962-8121-dee80516a833 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.180449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe4e8-8965-4962-8121-dee80516a833 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.180929 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe4e8-8965-4962-8121-dee80516a833 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.181867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe4e8-8965-4962-8121-dee80516a833 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.183528 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe4e8-8965-4962-8121-dee80516a833 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.217297 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae8ae7-9faf-4b3d-831f-46526262585d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.318629 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.319272 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.319563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.319862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.321719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:39.322041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.324827 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.358009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 17/35] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:39.359175 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.377942 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 19/36] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 24 00:14:39 2022] POST /identity/v3/roles => generated 225 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:39.378948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe4e8-8965-4962-8121-dee80516a833 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.475876 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:39.492376 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917efcdc-0d3c-469b-9a4c-b64f11f05988 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.542751 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe4e8-8965-4962-8121-dee80516a833 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.544158 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47486d-8092-4d5b-a659-f6aa75d7f798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.545372 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47486d-8092-4d5b-a659-f6aa75d7f798 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.546701 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47486d-8092-4d5b-a659-f6aa75d7f798 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.547234 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47486d-8092-4d5b-a659-f6aa75d7f798 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.549070 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47486d-8092-4d5b-a659-f6aa75d7f798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.550751 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47486d-8092-4d5b-a659-f6aa75d7f798 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.553212 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 18/37] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:39.554890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7bac-17d6-40e7-8dcb-3af15de7d371 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.555176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7bac-17d6-40e7-8dcb-3af15de7d371 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.555457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7bac-17d6-40e7-8dcb-3af15de7d371 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.556823 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 19/38] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:39.563772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0cb43-c60b-4f84-9d22-0beadce7b19e None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.563772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0cb43-c60b-4f84-9d22-0beadce7b19e None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.563772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0cb43-c60b-4f84-9d22-0beadce7b19e None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.563772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 20/39] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:39.563772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0cb43-c60b-4f84-9d22-0beadce7b19e None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.565361 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:39.590326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3debc6e-57aa-4040-9860-7bacb0215c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.591188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3debc6e-57aa-4040-9860-7bacb0215c92 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.591472 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3debc6e-57aa-4040-9860-7bacb0215c92 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.591749 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3debc6e-57aa-4040-9860-7bacb0215c92 None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.592431 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3debc6e-57aa-4040-9860-7bacb0215c92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.594061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3debc6e-57aa-4040-9860-7bacb0215c92 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.633242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:14:39 2022] POST /identity/v3/projects => generated 301 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:39.634564 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151565c-bce7-4956-88e0-906ecaae48fb None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.634880 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151565c-bce7-4956-88e0-906ecaae48fb None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.635130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151565c-bce7-4956-88e0-906ecaae48fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.654797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-2151565c-bce7-4956-88e0-906ecaae48fb None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:39.656477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-2151565c-bce7-4956-88e0-906ecaae48fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:39.688248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0cb43-c60b-4f84-9d22-0beadce7b19e None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.726036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369cbc7-95aa-4e82-99b9-397bff27aafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.726628 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cbc7-95aa-4e82-99b9-397bff27aafb None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.726910 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cbc7-95aa-4e82-99b9-397bff27aafb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.727194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cbc7-95aa-4e82-99b9-397bff27aafb None admin] PATH_INFO: `/v3/domains/default/users/d01b5a2be47a4a399c58e609908b5598/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.729587 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369cbc7-95aa-4e82-99b9-397bff27aafb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d01b5a2be47a4a399c58e609908b5598, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.731066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369cbc7-95aa-4e82-99b9-397bff27aafb None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.748181 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 21/41] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:39.749429 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 21/42] 10.222.0.70 () {58 vars in 1361 bytes} [Wed Aug 24 00:14:39 2022] PUT /identity/v3/domains/default/users/d01b5a2be47a4a399c58e609908b5598/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:39.749608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ead87-2c92-4cbe-a98f-081d8590e3b3 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.749729 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ead87-2c92-4cbe-a98f-081d8590e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.750008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ead87-2c92-4cbe-a98f-081d8590e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.774736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-0a6ead87-2c92-4cbe-a98f-081d8590e3b3 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:39.776122 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-0a6ead87-2c92-4cbe-a98f-081d8590e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:39.875451 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 22/43] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:40.105135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369cbc7-95aa-4e82-99b9-397bff27aafb None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:40.124203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:40.205541 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ead87-2c92-4cbe-a98f-081d8590e3b3 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:40.213603 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369cbc7-95aa-4e82-99b9-397bff27aafb None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:40.234932 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:40.251129 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7133f-b784-4f17-97a7-09dfe4d4a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:40.251793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7133f-b784-4f17-97a7-09dfe4d4a38c None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:40.252179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7133f-b784-4f17-97a7-09dfe4d4a38c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:40.252461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7133f-b784-4f17-97a7-09dfe4d4a38c None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:40.253956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7133f-b784-4f17-97a7-09dfe4d4a38c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:40.256038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7133f-b784-4f17-97a7-09dfe4d4a38c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:40.273831 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 22/44] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 24 00:14:40 2022] POST /identity/v3/roles => generated 223 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:40.323914 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ead87-2c92-4cbe-a98f-081d8590e3b3 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:40.361936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39991b4-9a62-43c1-ab67-eb0be00682dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:40.362499 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39991b4-9a62-43c1-ab67-eb0be00682dc None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:40.362784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39991b4-9a62-43c1-ab67-eb0be00682dc None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:40.363063 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39991b4-9a62-43c1-ab67-eb0be00682dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:40.364931 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39991b4-9a62-43c1-ab67-eb0be00682dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:40.366458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39991b4-9a62-43c1-ab67-eb0be00682dc None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:40.368320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 23/45] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:40.373953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7133f-b784-4f17-97a7-09dfe4d4a38c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:40.460878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:40.493600 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7133f-b784-4f17-97a7-09dfe4d4a38c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:40.530371 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11db26-6f59-4f0f-8250-ef8a83b9871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:40.530984 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11db26-6f59-4f0f-8250-ef8a83b9871b None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:40.531270 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11db26-6f59-4f0f-8250-ef8a83b9871b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:40.531547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11db26-6f59-4f0f-8250-ef8a83b9871b None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:40.532255 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11db26-6f59-4f0f-8250-ef8a83b9871b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:40.533708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11db26-6f59-4f0f-8250-ef8a83b9871b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:40.563756 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:14:40 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:41.974828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa713ec-ad79-46a0-b7a6-89c7d418d5f1 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.975370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa713ec-ad79-46a0-b7a6-89c7d418d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.975370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa713ec-ad79-46a0-b7a6-89c7d418d5f1 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.976780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 24/47] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:41.982208 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32de355-4bb0-4407-96d5-4169b5a98348 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.982621 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32de355-4bb0-4407-96d5-4169b5a98348 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.982887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32de355-4bb0-4407-96d5-4169b5a98348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.001643 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-d32de355-4bb0-4407-96d5-4169b5a98348 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:42.003158 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-d32de355-4bb0-4407-96d5-4169b5a98348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:42.070690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 24/48] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:42.415149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa713ec-ad79-46a0-b7a6-89c7d418d5f1 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.521546 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:42.529786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa713ec-ad79-46a0-b7a6-89c7d418d5f1 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.567513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0262-4d00-489f-a81a-4213abc4fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.568370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0262-4d00-489f-a81a-4213abc4fe0e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.568838 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0262-4d00-489f-a81a-4213abc4fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.569240 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0262-4d00-489f-a81a-4213abc4fe0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.580861 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af0262-4d00-489f-a81a-4213abc4fe0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-06af0262-4d00-489f-a81a-4213abc4fe0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:42.586393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:42.587242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:14:42.588015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 25/49] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:42.593530 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32de355-4bb0-4407-96d5-4169b5a98348 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.665772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:42.728735 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32de355-4bb0-4407-96d5-4169b5a98348 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.767665 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3854603-add6-4f5d-a0ca-c401292463e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.768309 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3854603-add6-4f5d-a0ca-c401292463e4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.768596 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3854603-add6-4f5d-a0ca-c401292463e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.768874 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3854603-add6-4f5d-a0ca-c401292463e4 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.769549 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3854603-add6-4f5d-a0ca-c401292463e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:42.769856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3854603-add6-4f5d-a0ca-c401292463e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.772523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3854603-add6-4f5d-a0ca-c401292463e4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.781858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 25/50] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:42.787895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0262-4d00-489f-a81a-4213abc4fe0e None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.910290 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278defa1-43c3-4feb-849e-8a6a707bfb92 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.910607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278defa1-43c3-4feb-849e-8a6a707bfb92 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.910947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278defa1-43c3-4feb-849e-8a6a707bfb92 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.912448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 26/51] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:42.920777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cebfd4-173e-4ff1-bc01-d003047759a4 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.922589 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cebfd4-173e-4ff1-bc01-d003047759a4 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.922871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cebfd4-173e-4ff1-bc01-d003047759a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.923138 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0262-4d00-489f-a81a-4213abc4fe0e None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.943075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-16cebfd4-173e-4ff1-bc01-d003047759a4 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:42.944481 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-16cebfd4-173e-4ff1-bc01-d003047759a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:42.968953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d1a0-22a1-4328-9600-1615c09a70e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.969590 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d1a0-22a1-4328-9600-1615c09a70e8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.969590 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d1a0-22a1-4328-9600-1615c09a70e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.970139 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d1a0-22a1-4328-9600-1615c09a70e8 None admin] PATH_INFO: `/v3/users/d01b5a2be47a4a399c58e609908b5598` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.971673 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141d1a0-22a1-4328-9600-1615c09a70e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d01b5a2be47a4a399c58e609908b5598)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.973704 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141d1a0-22a1-4328-9600-1615c09a70e8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.975343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 26/52] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/users/d01b5a2be47a4a399c58e609908b5598 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:42.982468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d1a0-22a1-4328-9600-1615c09a70e8 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:43.011116 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:43.035185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 27/53] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:43.100279 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d1a0-22a1-4328-9600-1615c09a70e8 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.137268 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9dfa9-a7be-4091-9daa-ad8218a45071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.137907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9dfa9-a7be-4091-9daa-ad8218a45071 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.138188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9dfa9-a7be-4091-9daa-ad8218a45071 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.138464 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9dfa9-a7be-4091-9daa-ad8218a45071 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.139600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9dfa9-a7be-4091-9daa-ad8218a45071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.141103 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9dfa9-a7be-4091-9daa-ad8218a45071 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.142680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 27/54] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:43.149132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cebfd4-173e-4ff1-bc01-d003047759a4 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:43.201702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:43.253742 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cebfd4-173e-4ff1-bc01-d003047759a4 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.288416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.289023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.289307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.289584 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.290310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.domain.id=default, user.id=d01b5a2be47a4a399c58e609908b5598) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:43.290617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.292090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.300387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 28/55] 10.222.0.70 () {56 vars in 1322 bytes} [Wed Aug 24 00:14:43 2022] GET /identity/v3/role_assignments?user.id=d01b5a2be47a4a399c58e609908b5598&scope.domain.id=default&role.id=952eea31fada4104858d315ac0f1296a => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:43.392276 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9dfa9-a7be-4091-9daa-ad8218a45071 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:43.491461 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:43.501489 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9dfa9-a7be-4091-9daa-ad8218a45071 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.538042 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01f281-6d42-4d7d-bc3f-9f3fe1b52cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.538680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f281-6d42-4d7d-bc3f-9f3fe1b52cb4 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.538964 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f281-6d42-4d7d-bc3f-9f3fe1b52cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.539238 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f281-6d42-4d7d-bc3f-9f3fe1b52cb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.540458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01f281-6d42-4d7d-bc3f-9f3fe1b52cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.541907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01f281-6d42-4d7d-bc3f-9f3fe1b52cb4 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.543487 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 28/56] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:43.549396 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:43.650107 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94091-0f20-421e-8408-f3d7f53c0098 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.664087 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:43.684482 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e54911-ba58-49d4-baaf-433b91f2821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.685070 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54911-ba58-49d4-baaf-433b91f2821b None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.685351 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54911-ba58-49d4-baaf-433b91f2821b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.685629 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e54911-ba58-49d4-baaf-433b91f2821b None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.686258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e54911-ba58-49d4-baaf-433b91f2821b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.687709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e54911-ba58-49d4-baaf-433b91f2821b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.713485 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 29/57] 10.222.0.70 () {60 vars in 1140 bytes} [Wed Aug 24 00:14:43 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:45.895980 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0b77d-839d-4cf9-8851-6f0b700a5e39 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:45.896497 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0b77d-839d-4cf9-8851-6f0b700a5e39 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:45.896497 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0b77d-839d-4cf9-8851-6f0b700a5e39 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:45.897848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 29/58] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:45.903061 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21c21-eedf-4e15-b609-3e3d2297bc33 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:45.903435 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21c21-eedf-4e15-b609-3e3d2297bc33 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:45.903626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21c21-eedf-4e15-b609-3e3d2297bc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:45.921935 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-3de21c21-eedf-4e15-b609-3e3d2297bc33 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:45.923125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-3de21c21-eedf-4e15-b609-3e3d2297bc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:45.989547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 30/59] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:46.328717 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0b77d-839d-4cf9-8851-6f0b700a5e39 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:46.427639 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0b77d-839d-4cf9-8851-6f0b700a5e39 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:46.461248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a13b21-8ca4-4e57-96b2-9de61af7ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:46.461869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a13b21-8ca4-4e57-96b2-9de61af7ff0e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:46.462150 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a13b21-8ca4-4e57-96b2-9de61af7ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:46.462423 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a13b21-8ca4-4e57-96b2-9de61af7ff0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:46.463533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a13b21-8ca4-4e57-96b2-9de61af7ff0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:46.464999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a13b21-8ca4-4e57-96b2-9de61af7ff0e None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:46.466555 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 30/60] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:46.472132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21c21-eedf-4e15-b609-3e3d2297bc33 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:46.565395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:46.572041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21c21-eedf-4e15-b609-3e3d2297bc33 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:46.606640 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd2dc8-093c-4d2d-afee-0a53abd563fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:46.607180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2dc8-093c-4d2d-afee-0a53abd563fc None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:46.607466 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2dc8-093c-4d2d-afee-0a53abd563fc None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:46.607745 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2dc8-093c-4d2d-afee-0a53abd563fc None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:46.608428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd2dc8-093c-4d2d-afee-0a53abd563fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:46.609887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd2dc8-093c-4d2d-afee-0a53abd563fc None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:46.637314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 31/61] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:14:46 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:50.179486 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df71d3-76b0-4842-b77c-7a71afd557dc None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.180357 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df71d3-76b0-4842-b77c-7a71afd557dc None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.180876 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df71d3-76b0-4842-b77c-7a71afd557dc None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.182407 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 31/62] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:50.189630 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59905d0-058e-46a1-9290-ecff8ee4b53d None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.190083 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59905d0-058e-46a1-9290-ecff8ee4b53d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.190190 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59905d0-058e-46a1-9290-ecff8ee4b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.205464 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7effb9-d39e-4dd3-ab0b-879fb0821f8f None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.205780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7effb9-d39e-4dd3-ab0b-879fb0821f8f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.206037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7effb9-d39e-4dd3-ab0b-879fb0821f8f None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.208297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 32/63] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:50.215381 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f924ec-c9c1-4008-863d-d019f165fd04 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.215663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f924ec-c9c1-4008-863d-d019f165fd04 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.216210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f924ec-c9c1-4008-863d-d019f165fd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.222935 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f59905d0-058e-46a1-9290-ecff8ee4b53d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:50.224198 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f59905d0-058e-46a1-9290-ecff8ee4b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:50.249708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b0f924ec-c9c1-4008-863d-d019f165fd04 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:50.251272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b0f924ec-c9c1-4008-863d-d019f165fd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:50.275008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:50.337850 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 33/64] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:50.340180 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015e2f-fb31-47d3-9363-e55de57be10a None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.340677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015e2f-fb31-47d3-9363-e55de57be10a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.341154 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015e2f-fb31-47d3-9363-e55de57be10a None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.342626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 34/65] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:50.350480 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfdb41-03bc-4525-af34-c7f423946a8f None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.352640 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfdb41-03bc-4525-af34-c7f423946a8f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.353993 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfdb41-03bc-4525-af34-c7f423946a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.362039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 32/66] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:50.380479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-0bdfdb41-03bc-4525-af34-c7f423946a8f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:50.382098 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-0bdfdb41-03bc-4525-af34-c7f423946a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:50.456991 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 35/67] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:50.543532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca75780-037d-4d38-9d01-538c749be514 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.544209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca75780-037d-4d38-9d01-538c749be514 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.544719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca75780-037d-4d38-9d01-538c749be514 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.546697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 33/68] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:50.553686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753636-ce3d-41db-98c0-8f92c8a350c2 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.553990 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753636-ce3d-41db-98c0-8f92c8a350c2 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.554243 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753636-ce3d-41db-98c0-8f92c8a350c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.588892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b0753636-ce3d-41db-98c0-8f92c8a350c2 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:50.590457 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b0753636-ce3d-41db-98c0-8f92c8a350c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:50.675587 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 36/69] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:50.722715 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4c832-35d9-450f-8a0f-5cc6273d1b2d None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.723951 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4c832-35d9-450f-8a0f-5cc6273d1b2d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.724420 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4c832-35d9-450f-8a0f-5cc6273d1b2d None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.725970 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 34/70] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:50.731316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb3d9-2d38-4159-a4bd-80048c9ffd8b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.731607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb3d9-2d38-4159-a4bd-80048c9ffd8b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.731911 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb3d9-2d38-4159-a4bd-80048c9ffd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.759365 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-8e4fb3d9-2d38-4159-a4bd-80048c9ffd8b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:50.760600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-8e4fb3d9-2d38-4159-a4bd-80048c9ffd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:50.776434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:50.776712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4c832-35d9-450f-8a0f-5cc6273d1b2d None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:50.864422 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 37/71] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:50.872872 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fb3d9-2d38-4159-a4bd-80048c9ffd8b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:50.876982 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:50.903303 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4c832-35d9-450f-8a0f-5cc6273d1b2d None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:50.943070 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a3209-8b53-42ba-8f9b-71e039645929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:50.944074 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a3209-8b53-42ba-8f9b-71e039645929 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.944680 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a3209-8b53-42ba-8f9b-71e039645929 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.945183 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a3209-8b53-42ba-8f9b-71e039645929 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.964974 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a3209-8b53-42ba-8f9b-71e039645929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-cf4a3209-8b53-42ba-8f9b-71e039645929 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:50.974899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:50.975953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:50.976922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:14:50.979479 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 35/72] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:50.980574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a3209-8b53-42ba-8f9b-71e039645929 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.037046 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fb3d9-2d38-4159-a4bd-80048c9ffd8b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.073215 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782cd8-1a89-422c-a756-ba6b5e209087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.073855 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782cd8-1a89-422c-a756-ba6b5e209087 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.074137 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782cd8-1a89-422c-a756-ba6b5e209087 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.074415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782cd8-1a89-422c-a756-ba6b5e209087 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.088073 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5782cd8-1a89-422c-a756-ba6b5e209087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-d5782cd8-1a89-422c-a756-ba6b5e209087 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:51.092947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:51.093786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:14:51.094520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 38/73] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:51.095131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a3209-8b53-42ba-8f9b-71e039645929 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.095199 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782cd8-1a89-422c-a756-ba6b5e209087 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.105016 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.136823 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d703088-c95f-4e5b-a1e2-3900d759f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.137513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d703088-c95f-4e5b-a1e2-3900d759f720 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.137793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d703088-c95f-4e5b-a1e2-3900d759f720 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.138067 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d703088-c95f-4e5b-a1e2-3900d759f720 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.149678 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d703088-c95f-4e5b-a1e2-3900d759f720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-1d703088-c95f-4e5b-a1e2-3900d759f720 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:51.154496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:51.155319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 36/74] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:51.156421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d703088-c95f-4e5b-a1e2-3900d759f720 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.159528 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.209556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782cd8-1a89-422c-a756-ba6b5e209087 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.246119 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.246651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.246931 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.247206 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.247893 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:51.248195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.249600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.258188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 39/75] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.258973 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.265818 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d703088-c95f-4e5b-a1e2-3900d759f720 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.300482 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7e5a-1d0b-4da9-bef6-f776626c7123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.301653 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7e5a-1d0b-4da9-bef6-f776626c7123 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.301992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7e5a-1d0b-4da9-bef6-f776626c7123 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.302213 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7e5a-1d0b-4da9-bef6-f776626c7123 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.312345 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c7e5a-1d0b-4da9-bef6-f776626c7123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-372c7e5a-1d0b-4da9-bef6-f776626c7123 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:51.319368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:51.320306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:14:51.321038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 37/76] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:51.321664 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7e5a-1d0b-4da9-bef6-f776626c7123 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.327302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.361514 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773680e-181a-4627-97ca-a9c43a9db477 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.382219 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.395940 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.396552 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.396833 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.397105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.397771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:51.398109 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.399502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.407647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 40/77] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.407647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.424025 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7e5a-1d0b-4da9-bef6-f776626c7123 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.469936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.470547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.471281 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.471566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.472275 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:51.472581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.474567 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.483928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 38/78] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.489355 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.521322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3c70-f461-406e-b189-63dec12abb83 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.549377 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.556287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d89c1-06a7-4649-a043-58ab3581ff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.556921 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d89c1-06a7-4649-a043-58ab3581ff8d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.557205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d89c1-06a7-4649-a043-58ab3581ff8d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.557484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d89c1-06a7-4649-a043-58ab3581ff8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.558618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d89c1-06a7-4649-a043-58ab3581ff8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.560140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d89c1-06a7-4649-a043-58ab3581ff8d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.561722 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 41/79] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.562490 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d89c1-06a7-4649-a043-58ab3581ff8d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.590968 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65120be-be64-4443-b09e-d5d7d1feeb76 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.613462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.626594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb674eca-1c32-4552-a311-7646ad019111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.627222 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb674eca-1c32-4552-a311-7646ad019111 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.627505 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb674eca-1c32-4552-a311-7646ad019111 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.627780 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb674eca-1c32-4552-a311-7646ad019111 None admin] PATH_INFO: `/v3/users/d01b5a2be47a4a399c58e609908b5598` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.629482 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb674eca-1c32-4552-a311-7646ad019111 None admin] RBAC: Authorizing `identity:get_user(user_id=d01b5a2be47a4a399c58e609908b5598)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.631111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb674eca-1c32-4552-a311-7646ad019111 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.632727 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 39/80] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/users/d01b5a2be47a4a399c58e609908b5598 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.636720 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb674eca-1c32-4552-a311-7646ad019111 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.663730 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d89c1-06a7-4649-a043-58ab3581ff8d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.697357 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.697965 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.698249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.698523 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.699181 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:51.699486 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.700908 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.710048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 42/81] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.710048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.738506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb674eca-1c32-4552-a311-7646ad019111 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.772128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.772294 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb95fe-07a6-4cde-beb5-3ad0610a616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.772707 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb95fe-07a6-4cde-beb5-3ad0610a616c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.772995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb95fe-07a6-4cde-beb5-3ad0610a616c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.773271 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb95fe-07a6-4cde-beb5-3ad0610a616c None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.789872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb95fe-07a6-4cde-beb5-3ad0610a616c None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.791372 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb95fe-07a6-4cde-beb5-3ad0610a616c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.793048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 40/82] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.793800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb95fe-07a6-4cde-beb5-3ad0610a616c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.812327 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45707f34-1bbf-4ce3-8b72-b1ee7135b504 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.845931 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428b8e6-4dd5-4964-8e8f-8ecb7aded73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.846563 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428b8e6-4dd5-4964-8e8f-8ecb7aded73e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.846853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428b8e6-4dd5-4964-8e8f-8ecb7aded73e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.847133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428b8e6-4dd5-4964-8e8f-8ecb7aded73e None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.847243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.848553 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428b8e6-4dd5-4964-8e8f-8ecb7aded73e None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.850065 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428b8e6-4dd5-4964-8e8f-8ecb7aded73e None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.851738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 43/83] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.856765 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428b8e6-4dd5-4964-8e8f-8ecb7aded73e None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.899024 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb95fe-07a6-4cde-beb5-3ad0610a616c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.934032 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583a7a6-e097-4545-88e2-02f408dc8f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.934637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a7a6-e097-4545-88e2-02f408dc8f8b None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.934921 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a7a6-e097-4545-88e2-02f408dc8f8b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.935200 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a7a6-e097-4545-88e2-02f408dc8f8b None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.935863 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583a7a6-e097-4545-88e2-02f408dc8f8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.937316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583a7a6-e097-4545-88e2-02f408dc8f8b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.955619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428b8e6-4dd5-4964-8e8f-8ecb7aded73e None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.957795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 41/84] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:14:51 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:51.958705 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583a7a6-e097-4545-88e2-02f408dc8f8b None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.996137 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.006809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a4c02-33df-442c-aec9-cddb0ef9326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.007564 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a4c02-33df-442c-aec9-cddb0ef9326b None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.007919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a4c02-33df-442c-aec9-cddb0ef9326b None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.008198 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a4c02-33df-442c-aec9-cddb0ef9326b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.079901 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583a7a6-e097-4545-88e2-02f408dc8f8b None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.089103 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.091532 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a4c02-33df-442c-aec9-cddb0ef9326b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.093236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a4c02-33df-442c-aec9-cddb0ef9326b None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.124663 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39e264-83ac-43af-a908-ead225fbff2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.125301 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e264-83ac-43af-a908-ead225fbff2d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.125581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e264-83ac-43af-a908-ead225fbff2d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.125852 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e264-83ac-43af-a908-ead225fbff2d None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.127009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39e264-83ac-43af-a908-ead225fbff2d None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.128511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39e264-83ac-43af-a908-ead225fbff2d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.130861 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 42/85] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:52.131455 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39e264-83ac-43af-a908-ead225fbff2d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.220953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 44/86] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:52.222053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a4c02-33df-442c-aec9-cddb0ef9326b None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.260361 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.264688 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39e264-83ac-43af-a908-ead225fbff2d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.311240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fd38-7c34-43b7-ab45-99f339716351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.311942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fd38-7c34-43b7-ab45-99f339716351 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.312219 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fd38-7c34-43b7-ab45-99f339716351 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.312477 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fd38-7c34-43b7-ab45-99f339716351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.367286 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.367717 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a4c02-33df-442c-aec9-cddb0ef9326b None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.401998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fd38-7c34-43b7-ab45-99f339716351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.403569 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fd38-7c34-43b7-ab45-99f339716351 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.416335 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd015cc0-18ee-434d-a46d-fb799733d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.416953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd015cc0-18ee-434d-a46d-fb799733d245 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.417241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd015cc0-18ee-434d-a46d-fb799733d245 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.417515 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd015cc0-18ee-434d-a46d-fb799733d245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.512827 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd015cc0-18ee-434d-a46d-fb799733d245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.515351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd015cc0-18ee-434d-a46d-fb799733d245 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.537736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 43/87] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:52.538734 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fd38-7c34-43b7-ab45-99f339716351 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.554426 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.628482 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.659095 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fd38-7c34-43b7-ab45-99f339716351 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.659948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 45/88] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:52.661540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd015cc0-18ee-434d-a46d-fb799733d245 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.701409 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4a3fa-2176-462e-aa23-15fa730e4c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.702193 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a3fa-2176-462e-aa23-15fa730e4c3c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.702573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a3fa-2176-462e-aa23-15fa730e4c3c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.702999 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a3fa-2176-462e-aa23-15fa730e4c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.778364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4a3fa-2176-462e-aa23-15fa730e4c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.779867 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4a3fa-2176-462e-aa23-15fa730e4c3c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.784565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd015cc0-18ee-434d-a46d-fb799733d245 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.814401 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.823712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fac58-378b-4b70-aab9-3ccaa23aaf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.824578 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fac58-378b-4b70-aab9-3ccaa23aaf41 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.825048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fac58-378b-4b70-aab9-3ccaa23aaf41 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.825526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fac58-378b-4b70-aab9-3ccaa23aaf41 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.826875 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fac58-378b-4b70-aab9-3ccaa23aaf41 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.828573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fac58-378b-4b70-aab9-3ccaa23aaf41 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.830740 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 46/89] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:52.831712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fac58-378b-4b70-aab9-3ccaa23aaf41 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.861755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.889705 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 44/90] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:52.890464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4a3fa-2176-462e-aa23-15fa730e4c3c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.944294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fac58-378b-4b70-aab9-3ccaa23aaf41 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.983435 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7023e-2e89-4895-acc5-2d69ef10e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.984452 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7023e-2e89-4895-acc5-2d69ef10e521 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.984937 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7023e-2e89-4895-acc5-2d69ef10e521 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.985505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7023e-2e89-4895-acc5-2d69ef10e521 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.987126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7023e-2e89-4895-acc5-2d69ef10e521 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.989127 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7023e-2e89-4895-acc5-2d69ef10e521 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.991063 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 47/91] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:52.992170 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7023e-2e89-4895-acc5-2d69ef10e521 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.995672 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4a3fa-2176-462e-aa23-15fa730e4c3c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.036573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c26144-6db3-437d-b86c-6d69335952a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.037959 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c26144-6db3-437d-b86c-6d69335952a7 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.038455 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c26144-6db3-437d-b86c-6d69335952a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.039361 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c26144-6db3-437d-b86c-6d69335952a7 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.041168 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c26144-6db3-437d-b86c-6d69335952a7 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.043387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c26144-6db3-437d-b86c-6d69335952a7 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.046282 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 45/92] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.047502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c26144-6db3-437d-b86c-6d69335952a7 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.067898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.096574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.114081 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7023e-2e89-4895-acc5-2d69ef10e521 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.153919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.154454 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.154735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.155011 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.155739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=303d80342777404a8a19015531902390, user.id=d01b5a2be47a4a399c58e609908b5598) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.156096 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.156961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c26144-6db3-437d-b86c-6d69335952a7 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.157540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.163651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 48/93] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/role_assignments?user.id=d01b5a2be47a4a399c58e609908b5598&scope.project.id=303d80342777404a8a19015531902390&role.id=952eea31fada4104858d315ac0f1296a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.164580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.206597 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a70389-dc2d-411e-9f42-22650fcda317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.207953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a70389-dc2d-411e-9f42-22650fcda317 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.208300 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a70389-dc2d-411e-9f42-22650fcda317 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.208578 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a70389-dc2d-411e-9f42-22650fcda317 None admin] PATH_INFO: `/v3/projects/6766582d1a3d4bdba58c1b9467cfc214` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.211778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a70389-dc2d-411e-9f42-22650fcda317 None admin] RBAC: Authorizing `identity:get_project(project_id=6766582d1a3d4bdba58c1b9467cfc214)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.213304 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a70389-dc2d-411e-9f42-22650fcda317 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.218813 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 46/94] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/projects/6766582d1a3d4bdba58c1b9467cfc214 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.220920 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a70389-dc2d-411e-9f42-22650fcda317 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.355078 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d28a2-19ee-4fba-93fc-d5a163ada72f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.398443 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.399068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.399355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.399635 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.400465 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] RBAC: Adding query filter params (role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=303d80342777404a8a19015531902390, user.id=c3a35815d3cd4180a8c9c6cf81caffcf) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.400783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.402237 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.410801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 49/95] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/role_assignments?user.id=c3a35815d3cd4180a8c9c6cf81caffcf&scope.project.id=303d80342777404a8a19015531902390&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.412079 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.414996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.507438 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a70389-dc2d-411e-9f42-22650fcda317 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.531944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.554004 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dfd06-08c1-4c6a-9671-f85c21f4bb15 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.586187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9706f-c2e3-489c-91f1-8697ca430df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.586810 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9706f-c2e3-489c-91f1-8697ca430df1 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.587094 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9706f-c2e3-489c-91f1-8697ca430df1 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.587372 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9706f-c2e3-489c-91f1-8697ca430df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.588147 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9706f-c2e3-489c-91f1-8697ca430df1 None admin] RBAC: Adding query filter params (role.id=bc92a32951104b92b187e6cb51ef9bd8, scope.project.id=303d80342777404a8a19015531902390, user.id=c3a35815d3cd4180a8c9c6cf81caffcf) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.588459 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9706f-c2e3-489c-91f1-8697ca430df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.589937 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9706f-c2e3-489c-91f1-8697ca430df1 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.592356 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed6977-0d30-4b40-b217-7c3538ca6927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.593176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6977-0d30-4b40-b217-7c3538ca6927 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.593459 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6977-0d30-4b40-b217-7c3538ca6927 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.593731 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6977-0d30-4b40-b217-7c3538ca6927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.594463 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6977-0d30-4b40-b217-7c3538ca6927 None admin] RBAC: Adding query filter params (role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=6766582d1a3d4bdba58c1b9467cfc214, user.id=c3a35815d3cd4180a8c9c6cf81caffcf) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.594771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6977-0d30-4b40-b217-7c3538ca6927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.596293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6977-0d30-4b40-b217-7c3538ca6927 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.602064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 47/96] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/role_assignments?user.id=c3a35815d3cd4180a8c9c6cf81caffcf&scope.project.id=303d80342777404a8a19015531902390&role.id=bc92a32951104b92b187e6cb51ef9bd8 => generated 259 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.608075 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 50/97] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/role_assignments?user.id=c3a35815d3cd4180a8c9c6cf81caffcf&scope.project.id=6766582d1a3d4bdba58c1b9467cfc214&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:54.604661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8ca4-12fb-41f5-ac1a-d4453dd51786 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:54.605342 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8ca4-12fb-41f5-ac1a-d4453dd51786 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:54.605342 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8ca4-12fb-41f5-ac1a-d4453dd51786 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:54.606563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 48/98] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:54.612023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44de5e0-430a-4caa-b7e1-88ada2655742 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:54.612489 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44de5e0-430a-4caa-b7e1-88ada2655742 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:54.612739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44de5e0-430a-4caa-b7e1-88ada2655742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:54.641158 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b44de5e0-430a-4caa-b7e1-88ada2655742 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:54.642416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b44de5e0-430a-4caa-b7e1-88ada2655742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:54.709649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:54.730750 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 51/99] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:54.813844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d1c0-7e84-45ff-b150-c1f8d2434275 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:54.814152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d1c0-7e84-45ff-b150-c1f8d2434275 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:54.814410 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d1c0-7e84-45ff-b150-c1f8d2434275 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:54.816039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 49/100] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:54.829732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3533fa-423c-460e-9dce-70fe352b1478 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:54.830279 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3533fa-423c-460e-9dce-70fe352b1478 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:54.830776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3533fa-423c-460e-9dce-70fe352b1478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:54.856023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-cd3533fa-423c-460e-9dce-70fe352b1478 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:54.857491 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-cd3533fa-423c-460e-9dce-70fe352b1478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:54.947126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 52/101] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:55.368266 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466d1c0-7e84-45ff-b150-c1f8d2434275 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:55.479734 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466d1c0-7e84-45ff-b150-c1f8d2434275 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:55.491332 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3533fa-423c-460e-9dce-70fe352b1478 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:55.526049 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cae8f7-a31c-41c1-b6d8-a4cb5a31f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:55.526672 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cae8f7-a31c-41c1-b6d8-a4cb5a31f963 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:55.526950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cae8f7-a31c-41c1-b6d8-a4cb5a31f963 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:55.527237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cae8f7-a31c-41c1-b6d8-a4cb5a31f963 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:55.528357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cae8f7-a31c-41c1-b6d8-a4cb5a31f963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:55.529783 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cae8f7-a31c-41c1-b6d8-a4cb5a31f963 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:55.535852 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 50/102] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:55.549829 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cae8f7-a31c-41c1-b6d8-a4cb5a31f963 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:55.617819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:55.696201 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cae8f7-a31c-41c1-b6d8-a4cb5a31f963 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:55.706769 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3533fa-423c-460e-9dce-70fe352b1478 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:55.742587 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:55.760540 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381402b-1dde-4054-b715-81ac5729c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:55.761519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381402b-1dde-4054-b715-81ac5729c450 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:55.762005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381402b-1dde-4054-b715-81ac5729c450 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:55.762470 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381402b-1dde-4054-b715-81ac5729c450 None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:55.763305 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381402b-1dde-4054-b715-81ac5729c450 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:55.765099 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381402b-1dde-4054-b715-81ac5729c450 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:55.774249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d005452-89ae-4b83-9fdf-151e8c463c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:55.775005 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d005452-89ae-4b83-9fdf-151e8c463c84 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:55.775178 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d005452-89ae-4b83-9fdf-151e8c463c84 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:55.775437 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d005452-89ae-4b83-9fdf-151e8c463c84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:55.813651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d005452-89ae-4b83-9fdf-151e8c463c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-6d005452-89ae-4b83-9fdf-151e8c463c84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:55.823849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:55.824879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:14:55.825647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 53/103] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:55.826750 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d005452-89ae-4b83-9fdf-151e8c463c84 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:55.830797 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 51/104] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:14:55 2022] POST /identity/v3/projects => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:14:55.958657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d005452-89ae-4b83-9fdf-151e8c463c84 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.000597 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.001223 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.001501 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.001770 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.002448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:56.002747 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.004755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.014432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 54/105] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:56.020865 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381402b-1dde-4054-b715-81ac5729c450 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.190445 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.198123 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381402b-1dde-4054-b715-81ac5729c450 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.245993 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f7975-25a1-4580-a750-015795808d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.246689 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f7975-25a1-4580-a750-015795808d1b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.246967 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f7975-25a1-4580-a750-015795808d1b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.247244 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f7975-25a1-4580-a750-015795808d1b None admin] PATH_INFO: `/v3/users/cec55d5dc7894d74a8143aede7b7706b` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.271751 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f7975-25a1-4580-a750-015795808d1b None admin] RBAC: Authorizing `identity:get_user(user_id=cec55d5dc7894d74a8143aede7b7706b)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.273280 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f7975-25a1-4580-a750-015795808d1b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.274979 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 52/106] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/users/cec55d5dc7894d74a8143aede7b7706b => generated 289 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:56.280623 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.331306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.400078 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177f352-3139-4adc-ae01-190146ef47eb None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.451573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034eab1-03b6-4d56-8f6e-c5b0da2b955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.452230 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034eab1-03b6-4d56-8f6e-c5b0da2b955d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.452582 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034eab1-03b6-4d56-8f6e-c5b0da2b955d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.452856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034eab1-03b6-4d56-8f6e-c5b0da2b955d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.541198 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034eab1-03b6-4d56-8f6e-c5b0da2b955d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.542735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034eab1-03b6-4d56-8f6e-c5b0da2b955d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.592776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.663860 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 55/107] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:56.669800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f7975-25a1-4580-a750-015795808d1b None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.673161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c10f-01d6-40a2-8f14-e09bc9953124 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.673161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c10f-01d6-40a2-8f14-e09bc9953124 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.673338 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c10f-01d6-40a2-8f14-e09bc9953124 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.674573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 56/108] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:56.681218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c48ba-fcc2-4fb3-9ac0-84197f91c7bf None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.681516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c48ba-fcc2-4fb3-9ac0-84197f91c7bf None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.681767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c48ba-fcc2-4fb3-9ac0-84197f91c7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.730018 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-7e9c48ba-fcc2-4fb3-9ac0-84197f91c7bf None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:56.731443 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-7e9c48ba-fcc2-4fb3-9ac0-84197f91c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:56.899102 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 57/109] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:56.919865 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f7975-25a1-4580-a750-015795808d1b None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.920455 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69061cb-09aa-4e66-a517-1d5dac17aedd None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.921318 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69061cb-09aa-4e66-a517-1d5dac17aedd None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.921786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69061cb-09aa-4e66-a517-1d5dac17aedd None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.923347 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 58/110] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:56.928690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926c8b-2c21-46a0-b102-6cc4a355f767 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.929266 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926c8b-2c21-46a0-b102-6cc4a355f767 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.929738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926c8b-2c21-46a0-b102-6cc4a355f767 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.931607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 59/111] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:56.933691 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36ca5-928b-47e7-998b-796dfde2783b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.934262 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36ca5-928b-47e7-998b-796dfde2783b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.934748 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36ca5-928b-47e7-998b-796dfde2783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.963504 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-32c36ca5-928b-47e7-998b-796dfde2783b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:56.965316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-32c36ca5-928b-47e7-998b-796dfde2783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:57.001666 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37226703-fd9b-4bda-a174-bb451480f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:57.002315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37226703-fd9b-4bda-a174-bb451480f607 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:57.002596 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37226703-fd9b-4bda-a174-bb451480f607 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:57.002865 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37226703-fd9b-4bda-a174-bb451480f607 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:57.005708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37226703-fd9b-4bda-a174-bb451480f607 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:57.007797 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37226703-fd9b-4bda-a174-bb451480f607 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:57.009636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 53/112] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:57.015911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddacec-6157-4ef6-8885-44bd2752929c None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:57.015911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddacec-6157-4ef6-8885-44bd2752929c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:57.015911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddacec-6157-4ef6-8885-44bd2752929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:57.046073 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-a5ddacec-6157-4ef6-8885-44bd2752929c None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:57.047274 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-a5ddacec-6157-4ef6-8885-44bd2752929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:57.058719 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:57.065254 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 60/113] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:57.071850 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36ca5-928b-47e7-998b-796dfde2783b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:57.073578 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:57.195065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 54/114] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:57.196368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948ba96-5709-4d9b-b5ee-536efe220072 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:57.196654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948ba96-5709-4d9b-b5ee-536efe220072 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:57.196927 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948ba96-5709-4d9b-b5ee-536efe220072 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:57.198296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 55/115] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:57.209152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5675-886d-4617-906f-5d3930a7d970 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:57.209437 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5675-886d-4617-906f-5d3930a7d970 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:57.209715 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5675-886d-4617-906f-5d3930a7d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:57.242731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-c40d5675-886d-4617-906f-5d3930a7d970 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:57.243950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-c40d5675-886d-4617-906f-5d3930a7d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:57.250831 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36ca5-928b-47e7-998b-796dfde2783b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:57.325881 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:57.326496 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:57.327080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:57.327194 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:57.327884 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] RBAC: Adding query filter params (role.id=f095e6999c454c259b2221c8b26d7ae7, scope.project.id=303d80342777404a8a19015531902390, user.id=cec55d5dc7894d74a8143aede7b7706b) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:57.328193 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:57.329646 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:57.340040 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 61/116] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:57 2022] GET /identity/v3/role_assignments?user.id=cec55d5dc7894d74a8143aede7b7706b&scope.project.id=303d80342777404a8a19015531902390&role.id=f095e6999c454c259b2221c8b26d7ae7 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:57.372174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 56/117] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:57.384996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:57.482365 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:57.554261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c4fbb-d1eb-44cd-a727-c497e766ae6a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:57.595799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea289a4-3843-4773-9218-0315ad9d4ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:57.596907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea289a4-3843-4773-9218-0315ad9d4ff1 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:57.597454 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea289a4-3843-4773-9218-0315ad9d4ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:57.597986 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea289a4-3843-4773-9218-0315ad9d4ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:57.610016 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea289a4-3843-4773-9218-0315ad9d4ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:57.612382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5675-886d-4617-906f-5d3930a7d970 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-2ea289a4-3843-4773-9218-0315ad9d4ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:57.617733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:57.618638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:57.619409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:14:57.622059 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 62/118] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:57.628385 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea289a4-3843-4773-9218-0315ad9d4ff1 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:57.748960 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:57.772106 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5675-886d-4617-906f-5d3930a7d970 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:57.785575 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea289a4-3843-4773-9218-0315ad9d4ff1 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:57.813226 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e8f0-0b23-46b5-8760-a65a80d1d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:57.813873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e8f0-0b23-46b5-8760-a65a80d1d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:57.814152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e8f0-0b23-46b5-8760-a65a80d1d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:57.814825 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e8f0-0b23-46b5-8760-a65a80d1d5e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:57.821191 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:57.832764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16e8f0-0b23-46b5-8760-a65a80d1d5e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:57.836755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:57.837587 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-bf16e8f0-0b23-46b5-8760-a65a80d1d5e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:57.837946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:57.838849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:14:57.839577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 57/119] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:57.840275 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e8f0-0b23-46b5-8760-a65a80d1d5e7 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:57.840597 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:57.841017 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:57.842003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:57.842463 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:57.844544 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:57.856616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 63/120] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:57.861666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:57.973841 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e8f0-0b23-46b5-8760-a65a80d1d5e7 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:57.981753 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5109d-880b-4eaf-a055-027ec853e426 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.021355 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe435-af7b-456a-9945-98c7dcefda38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.021911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe435-af7b-456a-9945-98c7dcefda38 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.022187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe435-af7b-456a-9945-98c7dcefda38 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.022456 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe435-af7b-456a-9945-98c7dcefda38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.025560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde56458-c7ae-4dd5-807d-3ac886b6d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.026092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde56458-c7ae-4dd5-807d-3ac886b6d83c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.026371 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde56458-c7ae-4dd5-807d-3ac886b6d83c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.026643 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde56458-c7ae-4dd5-807d-3ac886b6d83c None admin] PATH_INFO: `/v3/roles/member` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.034548 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:58.038918 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde56458-c7ae-4dd5-807d-3ac886b6d83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:58.039662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe435-af7b-456a-9945-98c7dcefda38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-fde56458-c7ae-4dd5-807d-3ac886b6d83c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:58.044916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:58.046041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:14:58.046797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 64/121] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-b89fe435-af7b-456a-9945-98c7dcefda38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:58.048557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:58.049379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:58.050111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:14:58.051990 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde56458-c7ae-4dd5-807d-3ac886b6d83c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.052864 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 58/122] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:58.053892 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe435-af7b-456a-9945-98c7dcefda38 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.102310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:58.180493 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe435-af7b-456a-9945-98c7dcefda38 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.181206 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde56458-c7ae-4dd5-807d-3ac886b6d83c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.218721 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909fad6-4e3c-412c-86a2-615c3cd10336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.219389 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909fad6-4e3c-412c-86a2-615c3cd10336 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.219661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909fad6-4e3c-412c-86a2-615c3cd10336 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.219980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909fad6-4e3c-412c-86a2-615c3cd10336 None admin] PATH_INFO: `/v3/users/d01b5a2be47a4a399c58e609908b5598` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.221214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909fad6-4e3c-412c-86a2-615c3cd10336 None admin] RBAC: Authorizing `identity:get_user(user_id=d01b5a2be47a4a399c58e609908b5598)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.223395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909fad6-4e3c-412c-86a2-615c3cd10336 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.229338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 59/123] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/users/d01b5a2be47a4a399c58e609908b5598 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.229338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909fad6-4e3c-412c-86a2-615c3cd10336 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.236081 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.236718 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.236998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.237277 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.238075 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:58.238888 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.244006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.252584 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 65/124] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.253439 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.320958 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:58.361520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885769-b087-47ca-9ddc-b7d1f8f2fd41 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.364778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909fad6-4e3c-412c-86a2-615c3cd10336 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.368835 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:58.402694 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.403402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.403734 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.404047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.404968 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:58.405088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.406463 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.410856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.412070 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.412292 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.413550 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.414487 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] RBAC: Adding query filter params (name=member) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:58.414759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.416145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.418112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 66/125] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.419494 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.425943 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 60/126] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.431355 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.551369 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f152fc-7d6c-4fdf-8603-c2746dd8942c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.552358 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb9337-764a-4601-b1e5-afb67e126b85 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.585238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:58.593342 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdfcfd-fb8e-4a29-97b5-412e9f9ce517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.593965 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdfcfd-fb8e-4a29-97b5-412e9f9ce517 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.594306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdfcfd-fb8e-4a29-97b5-412e9f9ce517 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.594611 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdfcfd-fb8e-4a29-97b5-412e9f9ce517 None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.596378 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdfcfd-fb8e-4a29-97b5-412e9f9ce517 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.599009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdfcfd-fb8e-4a29-97b5-412e9f9ce517 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.600888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 61/127] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.602074 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdfcfd-fb8e-4a29-97b5-412e9f9ce517 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.616781 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428522-d2e7-4dc0-a7fa-48d87deb3830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.617965 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428522-d2e7-4dc0-a7fa-48d87deb3830 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.618566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428522-d2e7-4dc0-a7fa-48d87deb3830 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.619334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428522-d2e7-4dc0-a7fa-48d87deb3830 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.621289 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428522-d2e7-4dc0-a7fa-48d87deb3830 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.623540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428522-d2e7-4dc0-a7fa-48d87deb3830 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.626533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 67/128] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.633176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428522-d2e7-4dc0-a7fa-48d87deb3830 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.683478 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:58.723648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdfcfd-fb8e-4a29-97b5-412e9f9ce517 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.756484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428522-d2e7-4dc0-a7fa-48d87deb3830 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.763305 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec66a-6920-4791-a5e4-69373937d939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.764450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec66a-6920-4791-a5e4-69373937d939 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.764881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec66a-6920-4791-a5e4-69373937d939 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.765394 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec66a-6920-4791-a5e4-69373937d939 None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.766730 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ec66a-6920-4791-a5e4-69373937d939 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.768500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ec66a-6920-4791-a5e4-69373937d939 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.771248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 62/129] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.772442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec66a-6920-4791-a5e4-69373937d939 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.794756 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78d7-25b9-439d-9117-f6c47f717298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.795559 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78d7-25b9-439d-9117-f6c47f717298 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.796292 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78d7-25b9-439d-9117-f6c47f717298 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.796642 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78d7-25b9-439d-9117-f6c47f717298 None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.797852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c78d7-25b9-439d-9117-f6c47f717298 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.799663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c78d7-25b9-439d-9117-f6c47f717298 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.802226 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 68/130] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.803922 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78d7-25b9-439d-9117-f6c47f717298 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.857640 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:58.900921 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec66a-6920-4791-a5e4-69373937d939 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.912992 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78d7-25b9-439d-9117-f6c47f717298 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:58.915408 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:58.943305 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4473-1227-4c96-b19f-f55331b6ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.944268 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4473-1227-4c96-b19f-f55331b6ef31 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.944969 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4473-1227-4c96-b19f-f55331b6ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.945424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4473-1227-4c96-b19f-f55331b6ef31 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.946785 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d4473-1227-4c96-b19f-f55331b6ef31 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.948478 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d4473-1227-4c96-b19f-f55331b6ef31 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.950734 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 63/131] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.950841 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc672a79-8291-4e3a-b809-ac543874eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:58.951629 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc672a79-8291-4e3a-b809-ac543874eb13 None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.952002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc672a79-8291-4e3a-b809-ac543874eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.952289 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4473-1227-4c96-b19f-f55331b6ef31 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:58.952392 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc672a79-8291-4e3a-b809-ac543874eb13 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390/users/d01b5a2be47a4a399c58e609908b5598/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.954456 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc672a79-8291-4e3a-b809-ac543874eb13 None admin] RBAC: Authorizing `identity:create_grant(project_id=303d80342777404a8a19015531902390, user_id=d01b5a2be47a4a399c58e609908b5598, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:58.956364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc672a79-8291-4e3a-b809-ac543874eb13 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:58.975502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 69/132] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:58 2022] PUT /identity/v3/projects/303d80342777404a8a19015531902390/users/d01b5a2be47a4a399c58e609908b5598/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:58.981220 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc672a79-8291-4e3a-b809-ac543874eb13 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:59.078141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4473-1227-4c96-b19f-f55331b6ef31 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:59.120703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85336b6a-e2d9-4f17-b299-af86ae882dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:59.121792 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336b6a-e2d9-4f17-b299-af86ae882dbe None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.122292 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336b6a-e2d9-4f17-b299-af86ae882dbe None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.122765 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336b6a-e2d9-4f17-b299-af86ae882dbe None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.124209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336b6a-e2d9-4f17-b299-af86ae882dbe None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:59.125938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336b6a-e2d9-4f17-b299-af86ae882dbe None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:59.127926 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 64/133] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:59.129219 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85336b6a-e2d9-4f17-b299-af86ae882dbe None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:59.132668 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:59.148178 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc672a79-8291-4e3a-b809-ac543874eb13 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:59.185287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15a94-544f-49dd-a9aa-f6f3327b69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:59.185947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15a94-544f-49dd-a9aa-f6f3327b69fb None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.186229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15a94-544f-49dd-a9aa-f6f3327b69fb None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.186503 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15a94-544f-49dd-a9aa-f6f3327b69fb None admin] PATH_INFO: `/v3/projects/6766582d1a3d4bdba58c1b9467cfc214` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.187716 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb15a94-544f-49dd-a9aa-f6f3327b69fb None admin] RBAC: Authorizing `identity:get_project(project_id=6766582d1a3d4bdba58c1b9467cfc214)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:59.189227 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb15a94-544f-49dd-a9aa-f6f3327b69fb None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:59.191691 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 70/134] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:58 2022] GET /identity/v3/projects/6766582d1a3d4bdba58c1b9467cfc214 => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:59.192520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15a94-544f-49dd-a9aa-f6f3327b69fb None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:59.235965 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:59.261500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85336b6a-e2d9-4f17-b299-af86ae882dbe None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:59.303197 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5be56-ac03-49bc-a1b7-a138960a480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:59.304252 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5be56-ac03-49bc-a1b7-a138960a480f None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.304741 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5be56-ac03-49bc-a1b7-a138960a480f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.305284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5be56-ac03-49bc-a1b7-a138960a480f None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390/users/c3a35815d3cd4180a8c9c6cf81caffcf/roles/bc92a32951104b92b187e6cb51ef9bd8` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.307885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5be56-ac03-49bc-a1b7-a138960a480f None admin] RBAC: Authorizing `identity:create_grant(project_id=303d80342777404a8a19015531902390, user_id=c3a35815d3cd4180a8c9c6cf81caffcf, role_id=bc92a32951104b92b187e6cb51ef9bd8)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:59.309843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5be56-ac03-49bc-a1b7-a138960a480f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:59.315695 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15a94-544f-49dd-a9aa-f6f3327b69fb None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:59.329007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 65/135] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:59 2022] PUT /identity/v3/projects/303d80342777404a8a19015531902390/users/c3a35815d3cd4180a8c9c6cf81caffcf/roles/bc92a32951104b92b187e6cb51ef9bd8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:59.330701 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5be56-ac03-49bc-a1b7-a138960a480f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:59.358407 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27233c18-1226-4bb6-9507-57ad5c1465a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:59.359095 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27233c18-1226-4bb6-9507-57ad5c1465a3 None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.359382 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27233c18-1226-4bb6-9507-57ad5c1465a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.359658 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27233c18-1226-4bb6-9507-57ad5c1465a3 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390/users/c3a35815d3cd4180a8c9c6cf81caffcf/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.361856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27233c18-1226-4bb6-9507-57ad5c1465a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=303d80342777404a8a19015531902390, user_id=c3a35815d3cd4180a8c9c6cf81caffcf, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:59.364215 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27233c18-1226-4bb6-9507-57ad5c1465a3 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:59.382331 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 71/136] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:59 2022] PUT /identity/v3/projects/303d80342777404a8a19015531902390/users/c3a35815d3cd4180a8c9c6cf81caffcf/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:59.383636 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ffb98-e070-4da7-a520-60e2babc2ad7 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.383973 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ffb98-e070-4da7-a520-60e2babc2ad7 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.384263 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ffb98-e070-4da7-a520-60e2babc2ad7 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.385599 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 72/137] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:59.392548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ebef-125b-4e09-beef-9acd88e2983e None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.392886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ebef-125b-4e09-beef-9acd88e2983e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.393099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ebef-125b-4e09-beef-9acd88e2983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.424823 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:59.426122 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-cc02ebef-125b-4e09-beef-9acd88e2983e None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:59.427384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-cc02ebef-125b-4e09-beef-9acd88e2983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:59.494592 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5be56-ac03-49bc-a1b7-a138960a480f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:59.554185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dacf99-7424-4f22-93ad-f1d8e731f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:59.555451 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dacf99-7424-4f22-93ad-f1d8e731f206 None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.557213 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dacf99-7424-4f22-93ad-f1d8e731f206 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.557707 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dacf99-7424-4f22-93ad-f1d8e731f206 None admin] PATH_INFO: `/v3/projects/6766582d1a3d4bdba58c1b9467cfc214/users/c3a35815d3cd4180a8c9c6cf81caffcf/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.561932 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dacf99-7424-4f22-93ad-f1d8e731f206 None admin] RBAC: Authorizing `identity:create_grant(project_id=6766582d1a3d4bdba58c1b9467cfc214, user_id=c3a35815d3cd4180a8c9c6cf81caffcf, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:59.563936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dacf99-7424-4f22-93ad-f1d8e731f206 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:59.578638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 73/138] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:59.606054 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 66/139] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:59 2022] PUT /identity/v3/projects/6766582d1a3d4bdba58c1b9467cfc214/users/c3a35815d3cd4180a8c9c6cf81caffcf/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:59.976377 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02ebef-125b-4e09-beef-9acd88e2983e None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:00.003133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:00.103625 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02ebef-125b-4e09-beef-9acd88e2983e None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:00.127414 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961fa3-9eac-4c31-8db6-8bd9ddf05c1f None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:00.128398 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961fa3-9eac-4c31-8db6-8bd9ddf05c1f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:00.128956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961fa3-9eac-4c31-8db6-8bd9ddf05c1f None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:00.130807 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 67/140] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:15:00.137141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3438135-97b1-4e1b-9c66-cbb2c748a21c None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:00.137659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3438135-97b1-4e1b-9c66-cbb2c748a21c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:00.138146 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3438135-97b1-4e1b-9c66-cbb2c748a21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:00.143893 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1522f4c-c9de-426b-834e-9bd5b3d78078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:00.145259 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1522f4c-c9de-426b-834e-9bd5b3d78078 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:00.145684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1522f4c-c9de-426b-834e-9bd5b3d78078 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:00.146075 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1522f4c-c9de-426b-834e-9bd5b3d78078 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:00.147342 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1522f4c-c9de-426b-834e-9bd5b3d78078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:00.148972 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1522f4c-c9de-426b-834e-9bd5b3d78078 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:00.150974 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 74/141] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:00.156447 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1522f4c-c9de-426b-834e-9bd5b3d78078 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:00.173088 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-e3438135-97b1-4e1b-9c66-cbb2c748a21c None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:00.174431 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-e3438135-97b1-4e1b-9c66-cbb2c748a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:00.272350 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:00.280959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1522f4c-c9de-426b-834e-9bd5b3d78078 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:00.322957 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b3cf7-7e74-41b7-9980-3130c05ec303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:00.324169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3cf7-7e74-41b7-9980-3130c05ec303 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:00.324698 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3cf7-7e74-41b7-9980-3130c05ec303 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:00.325170 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3cf7-7e74-41b7-9980-3130c05ec303 None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:00.326041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b3cf7-7e74-41b7-9980-3130c05ec303 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:00.327683 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b3cf7-7e74-41b7-9980-3130c05ec303 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:00.363304 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 75/142] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:00 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:15:00.368977 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 68/143] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:00.894981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b3cf7-7e74-41b7-9980-3130c05ec303 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:01.051406 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b3cf7-7e74-41b7-9980-3130c05ec303 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:01.104618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1517-1506-46ec-9717-a80033d23d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:01.105619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1517-1506-46ec-9717-a80033d23d46 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.106117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1517-1506-46ec-9717-a80033d23d46 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.106587 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1517-1506-46ec-9717-a80033d23d46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.124725 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a1517-1506-46ec-9717-a80033d23d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-243a1517-1506-46ec-9717-a80033d23d46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:01.130800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:01.131651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:01.132438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:01.135037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 76/144] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:01.140886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3438135-97b1-4e1b-9c66-cbb2c748a21c None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:01.233644 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:01.290444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3438135-97b1-4e1b-9c66-cbb2c748a21c None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:01.330575 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:01.331192 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.331476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.331812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.332512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:01.332816 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:01.334532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:01.345908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 69/145] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:01.352081 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1517-1506-46ec-9717-a80033d23d46 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:01.361708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:01.462302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1517-1506-46ec-9717-a80033d23d46 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:01.510206 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd106e5-57f9-4824-9b2b-7ee29c565826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:01.510771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd106e5-57f9-4824-9b2b-7ee29c565826 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.511048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd106e5-57f9-4824-9b2b-7ee29c565826 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.511318 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd106e5-57f9-4824-9b2b-7ee29c565826 None admin] PATH_INFO: `/v3/users/cec55d5dc7894d74a8143aede7b7706b` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.515544 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd106e5-57f9-4824-9b2b-7ee29c565826 None admin] RBAC: Authorizing `identity:get_user(user_id=cec55d5dc7894d74a8143aede7b7706b)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:01.517070 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd106e5-57f9-4824-9b2b-7ee29c565826 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:01.518709 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 77/146] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:01 2022] GET /identity/v3/users/cec55d5dc7894d74a8143aede7b7706b => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:01.524615 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:01.666994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f40e-7d3f-4e24-b4d0-6f03b52b7465 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:01.684203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:01.714069 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e504601-bb6e-41b2-865f-4d0e9ac894fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:01.714702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504601-bb6e-41b2-865f-4d0e9ac894fb None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.714982 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504601-bb6e-41b2-865f-4d0e9ac894fb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.715257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504601-bb6e-41b2-865f-4d0e9ac894fb None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.720543 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e504601-bb6e-41b2-865f-4d0e9ac894fb None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:01.721998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e504601-bb6e-41b2-865f-4d0e9ac894fb None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:01.724275 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 70/147] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:01 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:01.730004 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd106e5-57f9-4824-9b2b-7ee29c565826 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:01.842043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:01.872261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd106e5-57f9-4824-9b2b-7ee29c565826 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:01.914716 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428994f4-d1e8-4b84-938e-dd7c056fd270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:01.915387 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428994f4-d1e8-4b84-938e-dd7c056fd270 None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.915666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428994f4-d1e8-4b84-938e-dd7c056fd270 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.915966 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428994f4-d1e8-4b84-938e-dd7c056fd270 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390/users/cec55d5dc7894d74a8143aede7b7706b/roles/f095e6999c454c259b2221c8b26d7ae7` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.921439 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428994f4-d1e8-4b84-938e-dd7c056fd270 None admin] RBAC: Authorizing `identity:create_grant(project_id=303d80342777404a8a19015531902390, user_id=cec55d5dc7894d74a8143aede7b7706b, role_id=f095e6999c454c259b2221c8b26d7ae7)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:01.922932 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428994f4-d1e8-4b84-938e-dd7c056fd270 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:01.949808 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 78/148] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:15:01 2022] PUT /identity/v3/projects/303d80342777404a8a19015531902390/users/cec55d5dc7894d74a8143aede7b7706b/roles/f095e6999c454c259b2221c8b26d7ae7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:02.739128 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54b7a9-2b9a-4849-9e34-06fe32b0bfaa None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.739621 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54b7a9-2b9a-4849-9e34-06fe32b0bfaa None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.739696 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54b7a9-2b9a-4849-9e34-06fe32b0bfaa None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.741208 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 71/149] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:02.756080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746efb-5f26-4640-94e9-130a2a283f04 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.756581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746efb-5f26-4640-94e9-130a2a283f04 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.756654 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746efb-5f26-4640-94e9-130a2a283f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.781063 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-cc746efb-5f26-4640-94e9-130a2a283f04 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:02.782275 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-cc746efb-5f26-4640-94e9-130a2a283f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:02.880989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 79/150] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:03.248815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c83896-d393-4b27-a96d-9b6eeb17cb28 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:03.249205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c83896-d393-4b27-a96d-9b6eeb17cb28 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:03.249382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c83896-d393-4b27-a96d-9b6eeb17cb28 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:03.250884 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 72/151] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:03.256309 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e6e06-9751-465a-9c2f-cf1061197e47 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:03.256592 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e6e06-9751-465a-9c2f-cf1061197e47 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:03.256865 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e6e06-9751-465a-9c2f-cf1061197e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:03.280646 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-a39e6e06-9751-465a-9c2f-cf1061197e47 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:03.281831 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-a39e6e06-9751-465a-9c2f-cf1061197e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:03.356719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57ee73-49d5-45ac-93d0-b4afd491b2dc None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:03.357032 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57ee73-49d5-45ac-93d0-b4afd491b2dc None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:03.357264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57ee73-49d5-45ac-93d0-b4afd491b2dc None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:03.358588 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 73/152] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:15:03.377384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:03.383553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be35303-78bc-442e-b527-b51950cf078f None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:03.383857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be35303-78bc-442e-b527-b51950cf078f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:03.384131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be35303-78bc-442e-b527-b51950cf078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:03.405363 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 80/153] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:03.415755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-3be35303-78bc-442e-b527-b51950cf078f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:03.416975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-3be35303-78bc-442e-b527-b51950cf078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:03.513410 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 74/154] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 00:15:03.749496 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e6e06-9751-465a-9c2f-cf1061197e47 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:03.892828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e6e06-9751-465a-9c2f-cf1061197e47 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:03.929533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2af6e1-53c0-444d-ab63-942487b3d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:03.930166 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af6e1-53c0-444d-ab63-942487b3d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:03.930457 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af6e1-53c0-444d-ab63-942487b3d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:03.930728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af6e1-53c0-444d-ab63-942487b3d3c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:03.941028 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2af6e1-53c0-444d-ab63-942487b3d3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-0a2af6e1-53c0-444d-ab63-942487b3d3c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:03.945771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:03.946608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:03.947488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 81/155] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:03.952697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be35303-78bc-442e-b527-b51950cf078f None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:04.074866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be35303-78bc-442e-b527-b51950cf078f None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:04.091963 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:04.124625 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:04.125624 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:04.126092 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:04.126565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:04.127421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:04.127934 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:04.130402 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:04.143471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 75/156] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:04.150280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2af6e1-53c0-444d-ab63-942487b3d3c6 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:04.154440 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:04.275034 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:04.341868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58454b-9f33-47aa-9add-fdefc3017090 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:04.383859 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2af6e1-53c0-444d-ab63-942487b3d3c6 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:04.390333 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b15dc-3471-40e3-8736-bd313b4d13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:04.391239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b15dc-3471-40e3-8736-bd313b4d13f1 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:04.391712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b15dc-3471-40e3-8736-bd313b4d13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:04.392224 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b15dc-3471-40e3-8736-bd313b4d13f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:04.408787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b15dc-3471-40e3-8736-bd313b4d13f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-925b15dc-3471-40e3-8736-bd313b4d13f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:04.416050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:04.417185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:04.418023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:04.420508 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 76/157] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:04.423103 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08475b2-73f4-4cf5-8536-10f6230b9630 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:04.423588 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08475b2-73f4-4cf5-8536-10f6230b9630 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:04.424072 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08475b2-73f4-4cf5-8536-10f6230b9630 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:04.426643 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 77/158] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:04.427707 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08475b2-73f4-4cf5-8536-10f6230b9630 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:04.486074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b2cd0-edb7-49b4-9154-54ecf8745f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:04.486954 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2cd0-edb7-49b4-9154-54ecf8745f7d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:04.487472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:04.492249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2cd0-edb7-49b4-9154-54ecf8745f7d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:04.492531 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2cd0-edb7-49b4-9154-54ecf8745f7d None admin] PATH_INFO: `/v3/users/d01b5a2be47a4a399c58e609908b5598` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:04.493812 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b2cd0-edb7-49b4-9154-54ecf8745f7d None admin] RBAC: Authorizing `identity:get_user(user_id=d01b5a2be47a4a399c58e609908b5598)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:04.495276 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b2cd0-edb7-49b4-9154-54ecf8745f7d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:04.497238 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 82/159] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:04 2022] GET /identity/v3/users/d01b5a2be47a4a399c58e609908b5598 => generated 247 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:04.498023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b2cd0-edb7-49b4-9154-54ecf8745f7d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:04.606869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08475b2-73f4-4cf5-8536-10f6230b9630 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:04.689491 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af278cd2-7aa9-4404-89c9-c988e25a12da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:04.690040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af278cd2-7aa9-4404-89c9-c988e25a12da None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:04.690317 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af278cd2-7aa9-4404-89c9-c988e25a12da None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:04.690652 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af278cd2-7aa9-4404-89c9-c988e25a12da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:04.715561 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b2cd0-edb7-49b4-9154-54ecf8745f7d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:04.716711 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af278cd2-7aa9-4404-89c9-c988e25a12da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-af278cd2-7aa9-4404-89c9-c988e25a12da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:04.721500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:04.723216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:04.724469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 78/160] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:04.725330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047b2bf-cce2-4f7d-89d1-606239720684 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:04.725330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047b2bf-cce2-4f7d-89d1-606239720684 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:04.725330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047b2bf-cce2-4f7d-89d1-606239720684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:04.761481 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f047b2bf-cce2-4f7d-89d1-606239720684 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:04.762732 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f047b2bf-cce2-4f7d-89d1-606239720684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:04.763384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:04.791880 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:04.792970 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:04.793459 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:04.793926 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:04.794777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:04.795267 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:04.797332 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:04.812646 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 83/161] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:04.814056 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:04.891292 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 79/162] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:04.891988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047b2bf-cce2-4f7d-89d1-606239720684 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:04.949670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:05.022103 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1a021-d1bd-4c6a-a092-1ca9ea08bd38 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.085594 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17a92-c117-4e46-b587-b20e4a2028f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.086690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17a92-c117-4e46-b587-b20e4a2028f9 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.087180 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17a92-c117-4e46-b587-b20e4a2028f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.087663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17a92-c117-4e46-b587-b20e4a2028f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.095582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047b2bf-cce2-4f7d-89d1-606239720684 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.184561 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.185185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.185464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.185728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.186403 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:05.186697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:05.188111 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:05.189428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:05.203063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 80/163] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:05.203855 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.221386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef17a92-c117-4e46-b587-b20e4a2028f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:05.223330 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef17a92-c117-4e46-b587-b20e4a2028f9 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:05.358202 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 84/164] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:05.359510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17a92-c117-4e46-b587-b20e4a2028f9 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.429143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:05.454999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:05.477287 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0008-2a78-4a92-8232-f2c25f9c5412 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.487319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17a92-c117-4e46-b587-b20e4a2028f9 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.525989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801595dc-aaa6-4113-b39e-825bbf1b5de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.527221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801595dc-aaa6-4113-b39e-825bbf1b5de2 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.527724 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801595dc-aaa6-4113-b39e-825bbf1b5de2 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.528214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801595dc-aaa6-4113-b39e-825bbf1b5de2 None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.529573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801595dc-aaa6-4113-b39e-825bbf1b5de2 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:05.531292 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801595dc-aaa6-4113-b39e-825bbf1b5de2 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:05.533387 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 85/165] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:05.535674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fd4c0-dcec-4a82-87e0-cecd4335d8d9 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.536183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fd4c0-dcec-4a82-87e0-cecd4335d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.536781 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fd4c0-dcec-4a82-87e0-cecd4335d8d9 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.538370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 86/166] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:05.539706 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fd4c0-dcec-4a82-87e0-cecd4335d8d9 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.576983 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a917-0711-41ab-bdf6-e837da43b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.577730 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a917-0711-41ab-bdf6-e837da43b497 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.578011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a917-0711-41ab-bdf6-e837da43b497 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.578282 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a917-0711-41ab-bdf6-e837da43b497 None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.584654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673a917-0711-41ab-bdf6-e837da43b497 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:05.586138 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673a917-0711-41ab-bdf6-e837da43b497 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:05.587815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 81/167] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:05.589001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a917-0711-41ab-bdf6-e837da43b497 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.660901 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fd4c0-dcec-4a82-87e0-cecd4335d8d9 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.705529 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710644-0944-4a78-aaf9-6fdb6880b5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.708144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710644-0944-4a78-aaf9-6fdb6880b5f9 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.708689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710644-0944-4a78-aaf9-6fdb6880b5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.709170 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710644-0944-4a78-aaf9-6fdb6880b5f9 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.711922 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710644-0944-4a78-aaf9-6fdb6880b5f9 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:05.713784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710644-0944-4a78-aaf9-6fdb6880b5f9 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:05.718689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 87/168] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:05.724387 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba7233-f2f4-4adb-b541-316210ecce33 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.724885 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba7233-f2f4-4adb-b541-316210ecce33 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.725368 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba7233-f2f4-4adb-b541-316210ecce33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.758600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-39ba7233-f2f4-4adb-b541-316210ecce33 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:05.761076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-39ba7233-f2f4-4adb-b541-316210ecce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:05.796791 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:05.850132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a917-0711-41ab-bdf6-e837da43b497 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.858794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 88/169] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:05.860130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba7233-f2f4-4adb-b541-316210ecce33 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.939323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc556c-9e44-4fb9-8336-3eb6fa5853d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.939965 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc556c-9e44-4fb9-8336-3eb6fa5853d8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.940279 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc556c-9e44-4fb9-8336-3eb6fa5853d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.940524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc556c-9e44-4fb9-8336-3eb6fa5853d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.984724 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba7233-f2f4-4adb-b541-316210ecce33 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.993068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.068441 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1190c5-ccf2-4514-bd37-2693cab62968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.069782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1190c5-ccf2-4514-bd37-2693cab62968 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.070356 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1190c5-ccf2-4514-bd37-2693cab62968 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.070815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1190c5-ccf2-4514-bd37-2693cab62968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.098301 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc556c-9e44-4fb9-8336-3eb6fa5853d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.100559 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc556c-9e44-4fb9-8336-3eb6fa5853d8 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.116186 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.186612 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1190c5-ccf2-4514-bd37-2693cab62968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.188484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1190c5-ccf2-4514-bd37-2693cab62968 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.252024 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 82/170] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:06.252791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc556c-9e44-4fb9-8336-3eb6fa5853d8 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.290741 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 89/171] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:06.291584 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1190c5-ccf2-4514-bd37-2693cab62968 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.310657 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.341529 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.356993 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc556c-9e44-4fb9-8336-3eb6fa5853d8 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.391103 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1190c5-ccf2-4514-bd37-2693cab62968 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.391343 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b1fdc-01b1-44a0-897f-72122fef6710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.392000 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1fdc-01b1-44a0-897f-72122fef6710 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.392279 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1fdc-01b1-44a0-897f-72122fef6710 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.392550 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1fdc-01b1-44a0-897f-72122fef6710 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.402556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b1fdc-01b1-44a0-897f-72122fef6710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-431b1fdc-01b1-44a0-897f-72122fef6710 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:06.407264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:06.408218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:06.408988 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 83/172] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:06.409699 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23cf9-dbcb-475c-91f9-bce8f72c4a38 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.410126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23cf9-dbcb-475c-91f9-bce8f72c4a38 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.410126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23cf9-dbcb-475c-91f9-bce8f72c4a38 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.415948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 84/173] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:06.415948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633ccb-2138-47f1-b956-f486a93b6bf9 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.415948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633ccb-2138-47f1-b956-f486a93b6bf9 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.415948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633ccb-2138-47f1-b956-f486a93b6bf9 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.415948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 85/174] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:06.415948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633ccb-2138-47f1-b956-f486a93b6bf9 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.432524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b516197-e017-42fc-8cfc-22d35d2f528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.433127 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b516197-e017-42fc-8cfc-22d35d2f528e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.433403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b516197-e017-42fc-8cfc-22d35d2f528e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.433675 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b516197-e017-42fc-8cfc-22d35d2f528e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.434408 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b516197-e017-42fc-8cfc-22d35d2f528e None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=303d80342777404a8a19015531902390, user.id=d01b5a2be47a4a399c58e609908b5598) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:06.434710 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b516197-e017-42fc-8cfc-22d35d2f528e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.436196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b516197-e017-42fc-8cfc-22d35d2f528e None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.442701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 90/175] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:06 2022] GET /identity/v3/role_assignments?user.id=d01b5a2be47a4a399c58e609908b5598&scope.project.id=303d80342777404a8a19015531902390&role.id=952eea31fada4104858d315ac0f1296a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:06.443752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc4005-1ac2-47da-849d-11e278e0f5cd None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.444068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc4005-1ac2-47da-849d-11e278e0f5cd None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.444337 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc4005-1ac2-47da-849d-11e278e0f5cd None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.445815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 91/176] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:06.446547 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc4005-1ac2-47da-849d-11e278e0f5cd None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.543646 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633ccb-2138-47f1-b956-f486a93b6bf9 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.564803 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.583080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc4005-1ac2-47da-849d-11e278e0f5cd None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.593415 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6c55-e62a-4da1-a82d-78a4ef081b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.594048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6c55-e62a-4da1-a82d-78a4ef081b6c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.594325 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6c55-e62a-4da1-a82d-78a4ef081b6c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.594596 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6c55-e62a-4da1-a82d-78a4ef081b6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.599305 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.607571 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f6c55-e62a-4da1-a82d-78a4ef081b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-345f6c55-e62a-4da1-a82d-78a4ef081b6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:06.612719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:06.613650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:06.614452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 86/177] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:06.615105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6c55-e62a-4da1-a82d-78a4ef081b6c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.630293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528dcd3-7b67-4fff-8c83-0e40ebdc0669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.631242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528dcd3-7b67-4fff-8c83-0e40ebdc0669 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.631530 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528dcd3-7b67-4fff-8c83-0e40ebdc0669 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.631808 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528dcd3-7b67-4fff-8c83-0e40ebdc0669 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.634284 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528dcd3-7b67-4fff-8c83-0e40ebdc0669 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.635754 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528dcd3-7b67-4fff-8c83-0e40ebdc0669 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.637455 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 92/178] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:06 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:06.638219 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528dcd3-7b67-4fff-8c83-0e40ebdc0669 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.742036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6c55-e62a-4da1-a82d-78a4ef081b6c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.754622 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528dcd3-7b67-4fff-8c83-0e40ebdc0669 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.775801 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dfdb7-14cf-4f17-af6f-67d49336f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.776448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dfdb7-14cf-4f17-af6f-67d49336f03e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.776730 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dfdb7-14cf-4f17-af6f-67d49336f03e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.777005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dfdb7-14cf-4f17-af6f-67d49336f03e None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.778136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dfdb7-14cf-4f17-af6f-67d49336f03e None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.779599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dfdb7-14cf-4f17-af6f-67d49336f03e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.781331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 87/179] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:06 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:06.782502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70513-2380-45ac-a728-afc8129d1251 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.782796 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70513-2380-45ac-a728-afc8129d1251 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.783064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff70513-2380-45ac-a728-afc8129d1251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.789036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d137676-076e-4e61-a95e-bd4eca758a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.789648 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d137676-076e-4e61-a95e-bd4eca758a16 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.789930 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d137676-076e-4e61-a95e-bd4eca758a16 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.790206 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d137676-076e-4e61-a95e-bd4eca758a16 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.790869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d137676-076e-4e61-a95e-bd4eca758a16 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:06.791234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d137676-076e-4e61-a95e-bd4eca758a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.792646 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d137676-076e-4e61-a95e-bd4eca758a16 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.801699 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 93/180] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:06.802415 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-6ff70513-2380-45ac-a728-afc8129d1251 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:06.802830 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125a9c5-ef1e-4f06-bf36-8f986fe2c496 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.803176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125a9c5-ef1e-4f06-bf36-8f986fe2c496 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.803414 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125a9c5-ef1e-4f06-bf36-8f986fe2c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.803627 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-6ff70513-2380-45ac-a728-afc8129d1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:06.821571 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-4125a9c5-ef1e-4f06-bf36-8f986fe2c496 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:06.822772 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-4125a9c5-ef1e-4f06-bf36-8f986fe2c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:06.843869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.864901 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.876582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 88/181] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:06.877800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ba0e-7662-4e45-bb27-ad6966ccc0aa None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.878082 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ba0e-7662-4e45-bb27-ad6966ccc0aa None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.878376 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ba0e-7662-4e45-bb27-ad6966ccc0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.898157 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-ef29ba0e-7662-4e45-bb27-ad6966ccc0aa None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:06.899345 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-ef29ba0e-7662-4e45-bb27-ad6966ccc0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:06.912046 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 94/182] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:06.912046 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125a9c5-ef1e-4f06-bf36-8f986fe2c496 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.999890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 89/183] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:07.001137 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ba0e-7662-4e45-bb27-ad6966ccc0aa None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.027680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125a9c5-ef1e-4f06-bf36-8f986fe2c496 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.077164 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.077802 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.077999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.078217 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.079184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:07.079184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:07.080645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:07.100451 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 95/184] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:07.102337 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.116941 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ba0e-7662-4e45-bb27-ad6966ccc0aa None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.119158 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:07.156890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.157813 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.158259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.158693 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.160181 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] RBAC: Adding query filter params (role.id=bc92a32951104b92b187e6cb51ef9bd8, scope.project.id=303d80342777404a8a19015531902390, user.id=c3a35815d3cd4180a8c9c6cf81caffcf) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:07.160660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:07.162273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:07.168899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 90/185] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/role_assignments?user.id=c3a35815d3cd4180a8c9c6cf81caffcf&scope.project.id=303d80342777404a8a19015531902390&role.id=bc92a32951104b92b187e6cb51ef9bd8 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:07.169954 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.171616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:07.267498 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adac02f-dfb4-458a-902e-140a266bc2ab None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.294788 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c572a16-7698-4dcd-be5c-8309ef23b396 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.311395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.312045 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.312349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.312601 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.318100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] RBAC: Adding query filter params (role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=303d80342777404a8a19015531902390, user.id=c3a35815d3cd4180a8c9c6cf81caffcf) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:07.318100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:07.318100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:07.322583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 96/186] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/role_assignments?user.id=c3a35815d3cd4180a8c9c6cf81caffcf&scope.project.id=303d80342777404a8a19015531902390&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:07.323417 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.371791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85918a09-3d7b-4994-b7c6-6d1a166dc327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.372384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918a09-3d7b-4994-b7c6-6d1a166dc327 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.372667 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918a09-3d7b-4994-b7c6-6d1a166dc327 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.372939 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918a09-3d7b-4994-b7c6-6d1a166dc327 None admin] PATH_INFO: `/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85918a09-3d7b-4994-b7c6-6d1a166dc327 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a35815d3cd4180a8c9c6cf81caffcf)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:07.379127 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85918a09-3d7b-4994-b7c6-6d1a166dc327 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:07.389556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 91/187] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/users/c3a35815d3cd4180a8c9c6cf81caffcf => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:07.390526 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85918a09-3d7b-4994-b7c6-6d1a166dc327 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.460474 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:07.492103 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:07.497155 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30393aea-d16a-4372-be25-b89fa8b5c7bd None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.539737 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abfa6c-6c16-4535-b95b-b031fa260e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.540713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abfa6c-6c16-4535-b95b-b031fa260e60 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.540713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abfa6c-6c16-4535-b95b-b031fa260e60 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.540961 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abfa6c-6c16-4535-b95b-b031fa260e60 None admin] PATH_INFO: `/v3/users/b940abc520b44c2bbd3cc5a79174d642` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.562013 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abfa6c-6c16-4535-b95b-b031fa260e60 None admin] RBAC: Authorizing `identity:get_user(user_id=b940abc520b44c2bbd3cc5a79174d642)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:07.563385 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abfa6c-6c16-4535-b95b-b031fa260e60 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:07.565125 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 97/188] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/users/b940abc520b44c2bbd3cc5a79174d642 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:07.565940 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abfa6c-6c16-4535-b95b-b031fa260e60 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.566176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85918a09-3d7b-4994-b7c6-6d1a166dc327 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.628053 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb6816-a0e0-4ee2-9b4c-81373ad011d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.629125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb6816-a0e0-4ee2-9b4c-81373ad011d9 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.629469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb6816-a0e0-4ee2-9b4c-81373ad011d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.629821 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb6816-a0e0-4ee2-9b4c-81373ad011d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.640987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb6816-a0e0-4ee2-9b4c-81373ad011d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-a2bb6816-a0e0-4ee2-9b4c-81373ad011d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:07.647719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:07.648781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:07.649722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 92/189] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:07.650493 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb6816-a0e0-4ee2-9b4c-81373ad011d9 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.697815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abfa6c-6c16-4535-b95b-b031fa260e60 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.731917 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6ead-9737-49c2-bf09-9ce0dd060b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.732522 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6ead-9737-49c2-bf09-9ce0dd060b43 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.732801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6ead-9737-49c2-bf09-9ce0dd060b43 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.733068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6ead-9737-49c2-bf09-9ce0dd060b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.745335 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:07.752505 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb6816-a0e0-4ee2-9b4c-81373ad011d9 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.759562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:07.789086 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6718b68-2166-4a71-92cd-acf19e4df5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.789711 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6718b68-2166-4a71-92cd-acf19e4df5ab None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.789992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6718b68-2166-4a71-92cd-acf19e4df5ab None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.790266 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6718b68-2166-4a71-92cd-acf19e4df5ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.791380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6718b68-2166-4a71-92cd-acf19e4df5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:07.792921 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6718b68-2166-4a71-92cd-acf19e4df5ab None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:07.794491 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 93/190] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:07.795265 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6718b68-2166-4a71-92cd-acf19e4df5ab None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.802030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee6ead-9737-49c2-bf09-9ce0dd060b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:07.803499 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee6ead-9737-49c2-bf09-9ce0dd060b43 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:07.896881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6718b68-2166-4a71-92cd-acf19e4df5ab None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:07.904051 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 98/191] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:07.904886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6ead-9737-49c2-bf09-9ce0dd060b43 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.932425 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385e6e1-3a7f-4b29-8dbc-5f12ddc54519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:07.933077 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6e1-3a7f-4b29-8dbc-5f12ddc54519 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:07.933293 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6e1-3a7f-4b29-8dbc-5f12ddc54519 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:07.933563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6e1-3a7f-4b29-8dbc-5f12ddc54519 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:07.943736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385e6e1-3a7f-4b29-8dbc-5f12ddc54519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-1385e6e1-3a7f-4b29-8dbc-5f12ddc54519 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:07.948994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:07.949938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:07.950728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 94/192] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:07.951358 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385e6e1-3a7f-4b29-8dbc-5f12ddc54519 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:07.966917 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:07.977406 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:08.014738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6ead-9737-49c2-bf09-9ce0dd060b43 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.050091 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd5eff-33be-49dc-a026-900e846c1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.050691 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5eff-33be-49dc-a026-900e846c1c16 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.050967 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5eff-33be-49dc-a026-900e846c1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.051247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5eff-33be-49dc-a026-900e846c1c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.056761 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385e6e1-3a7f-4b29-8dbc-5f12ddc54519 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.090902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.091497 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.091770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.092071 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.092723 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:08.093020 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.094377 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.102228 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 95/193] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:08.102803 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.121978 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd5eff-33be-49dc-a026-900e846c1c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.123473 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd5eff-33be-49dc-a026-900e846c1c16 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.182488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:08.184808 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:08.201421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef9daf-4fb9-43e4-8a00-c901c28bb49d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.225554 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 99/194] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:08.231056 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd5eff-33be-49dc-a026-900e846c1c16 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.234213 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864fac7-21d0-49f3-a283-eff4c99bfe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.234816 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864fac7-21d0-49f3-a283-eff4c99bfe42 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.235087 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864fac7-21d0-49f3-a283-eff4c99bfe42 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.235353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864fac7-21d0-49f3-a283-eff4c99bfe42 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.236012 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864fac7-21d0-49f3-a283-eff4c99bfe42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.237470 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864fac7-21d0-49f3-a283-eff4c99bfe42 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.258511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 96/195] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:08 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:08.259335 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864fac7-21d0-49f3-a283-eff4c99bfe42 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.359448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd5eff-33be-49dc-a026-900e846c1c16 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.376386 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864fac7-21d0-49f3-a283-eff4c99bfe42 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.400722 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50203-b024-4cf0-a62d-7b487f6f9040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.401423 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50203-b024-4cf0-a62d-7b487f6f9040 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.401704 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50203-b024-4cf0-a62d-7b487f6f9040 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.401973 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50203-b024-4cf0-a62d-7b487f6f9040 None admin] PATH_INFO: `/v3/projects/6766582d1a3d4bdba58c1b9467cfc214` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.403131 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e50203-b024-4cf0-a62d-7b487f6f9040 None admin] RBAC: Authorizing `identity:get_project(project_id=6766582d1a3d4bdba58c1b9467cfc214)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.404794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e50203-b024-4cf0-a62d-7b487f6f9040 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.411917 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 100/196] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/projects/6766582d1a3d4bdba58c1b9467cfc214 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:08.411917 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50203-b024-4cf0-a62d-7b487f6f9040 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.422062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.422688 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.422966 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.423279 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.424016 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:08.424304 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.425757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.435538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 97/197] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:08.435691 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.438396 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:08.445576 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:08.547285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50203-b024-4cf0-a62d-7b487f6f9040 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.579057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3942de9-9276-4486-9040-908b1c033ba9 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.595454 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fba95-319b-4932-882a-294081121f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.596137 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fba95-319b-4932-882a-294081121f95 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.596415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fba95-319b-4932-882a-294081121f95 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.596686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fba95-319b-4932-882a-294081121f95 None admin] PATH_INFO: `/v3/users/b940abc520b44c2bbd3cc5a79174d642` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.598058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fba95-319b-4932-882a-294081121f95 None admin] RBAC: Authorizing `identity:get_user(user_id=b940abc520b44c2bbd3cc5a79174d642)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.599516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fba95-319b-4932-882a-294081121f95 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.601156 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 101/198] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/users/b940abc520b44c2bbd3cc5a79174d642 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:08.602003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fba95-319b-4932-882a-294081121f95 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.629659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b349-e0fa-4a84-82ad-241929b7c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.630353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b349-e0fa-4a84-82ad-241929b7c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.630643 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b349-e0fa-4a84-82ad-241929b7c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.630899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b349-e0fa-4a84-82ad-241929b7c2f6 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.633344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b349-e0fa-4a84-82ad-241929b7c2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.633701 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b349-e0fa-4a84-82ad-241929b7c2f6 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.635333 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 98/199] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:08.636131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b349-e0fa-4a84-82ad-241929b7c2f6 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.725843 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fba95-319b-4932-882a-294081121f95 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.729198 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:08.740707 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:08.770001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b349-e0fa-4a84-82ad-241929b7c2f6 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.772990 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.774025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.774729 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.775328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.777185 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] RBAC: Adding query filter params (role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=6766582d1a3d4bdba58c1b9467cfc214, user.id=c3a35815d3cd4180a8c9c6cf81caffcf) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:08.777786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.779567 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.787909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 102/200] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/role_assignments?user.id=c3a35815d3cd4180a8c9c6cf81caffcf&scope.project.id=6766582d1a3d4bdba58c1b9467cfc214&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:08.789187 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.836946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a9b5-1d3b-4e9f-aca3-c06916bb71aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:08.839013 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a9b5-1d3b-4e9f-aca3-c06916bb71aa None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.840201 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a9b5-1d3b-4e9f-aca3-c06916bb71aa None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.840705 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a9b5-1d3b-4e9f-aca3-c06916bb71aa None admin] PATH_INFO: `/v3/users/cec55d5dc7894d74a8143aede7b7706b` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.843207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a9b5-1d3b-4e9f-aca3-c06916bb71aa None admin] RBAC: Authorizing `identity:get_user(user_id=cec55d5dc7894d74a8143aede7b7706b)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:08.847571 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a9b5-1d3b-4e9f-aca3-c06916bb71aa None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:08.853488 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 99/201] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/users/cec55d5dc7894d74a8143aede7b7706b => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:08.857067 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a9b5-1d3b-4e9f-aca3-c06916bb71aa None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.005685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737a94-5330-47e8-b469-0ca74b20953c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.021327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a9b5-1d3b-4e9f-aca3-c06916bb71aa None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.064253 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab15b59-0217-43f4-9bda-0df3ad914b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.065228 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15b59-0217-43f4-9bda-0df3ad914b87 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.065855 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.066119 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15b59-0217-43f4-9bda-0df3ad914b87 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.066546 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.066784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15b59-0217-43f4-9bda-0df3ad914b87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.066881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.067078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.068724 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb, user.id=b940abc520b44c2bbd3cc5a79174d642) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:09.068724 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.069757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.075668 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 100/202] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/role_assignments?user.id=b940abc520b44c2bbd3cc5a79174d642&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=952eea31fada4104858d315ac0f1296a => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:09.076531 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.079277 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.102908 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.150954 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab15b59-0217-43f4-9bda-0df3ad914b87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.153251 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab15b59-0217-43f4-9bda-0df3ad914b87 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.194240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1438-2e92-464e-896a-a4a0cd45d9fb None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.233669 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd936c-4dd2-4f12-a0d6-dedc3df57fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.234284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd936c-4dd2-4f12-a0d6-dedc3df57fbd None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.234560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd936c-4dd2-4f12-a0d6-dedc3df57fbd None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.234832 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd936c-4dd2-4f12-a0d6-dedc3df57fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.272625 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 103/203] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:09.278324 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab15b59-0217-43f4-9bda-0df3ad914b87 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.310462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd936c-4dd2-4f12-a0d6-dedc3df57fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.312028 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd936c-4dd2-4f12-a0d6-dedc3df57fbd None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.313911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.354846 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.403763 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab15b59-0217-43f4-9bda-0df3ad914b87 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.424468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 101/204] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:09.437120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd936c-4dd2-4f12-a0d6-dedc3df57fbd None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.447432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc6516-0303-4fa9-a1a0-c387098859c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.448166 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc6516-0303-4fa9-a1a0-c387098859c8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.448445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc6516-0303-4fa9-a1a0-c387098859c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.448717 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc6516-0303-4fa9-a1a0-c387098859c8 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.449925 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc6516-0303-4fa9-a1a0-c387098859c8 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.451393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc6516-0303-4fa9-a1a0-c387098859c8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.453077 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 104/205] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:09.459775 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc6516-0303-4fa9-a1a0-c387098859c8 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.561014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd936c-4dd2-4f12-a0d6-dedc3df57fbd None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.563311 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.579343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc6516-0303-4fa9-a1a0-c387098859c8 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.606811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.610590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6cb26-59db-4f17-8166-4b7f40b70bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.611430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6cb26-59db-4f17-8166-4b7f40b70bb4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.611922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6cb26-59db-4f17-8166-4b7f40b70bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.612347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6cb26-59db-4f17-8166-4b7f40b70bb4 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.613920 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6cb26-59db-4f17-8166-4b7f40b70bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.615809 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6cb26-59db-4f17-8166-4b7f40b70bb4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.617727 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 102/206] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:09.623919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467bdcb-c81c-470d-b019-beef588bb541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.624806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467bdcb-c81c-470d-b019-beef588bb541 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.625277 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467bdcb-c81c-470d-b019-beef588bb541 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.625827 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467bdcb-c81c-470d-b019-beef588bb541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.626749 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467bdcb-c81c-470d-b019-beef588bb541 None admin] RBAC: Adding query filter params (role.id=bc92a32951104b92b187e6cb51ef9bd8, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb, user.id=b940abc520b44c2bbd3cc5a79174d642) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:09.627265 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467bdcb-c81c-470d-b019-beef588bb541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.630138 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467bdcb-c81c-470d-b019-beef588bb541 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.630298 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6cb26-59db-4f17-8166-4b7f40b70bb4 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.648514 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 105/207] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/role_assignments?user.id=b940abc520b44c2bbd3cc5a79174d642&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=bc92a32951104b92b187e6cb51ef9bd8 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:09.764597 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6cb26-59db-4f17-8166-4b7f40b70bb4 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.807109 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f9b58-3616-4fe1-a1e8-999398f9f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.807729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f9b58-3616-4fe1-a1e8-999398f9f6ca None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.808061 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f9b58-3616-4fe1-a1e8-999398f9f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.808295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f9b58-3616-4fe1-a1e8-999398f9f6ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.809047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f9b58-3616-4fe1-a1e8-999398f9f6ca None admin] RBAC: Adding query filter params (role.id=f095e6999c454c259b2221c8b26d7ae7, scope.project.id=303d80342777404a8a19015531902390, user.id=cec55d5dc7894d74a8143aede7b7706b) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:09.809351 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f9b58-3616-4fe1-a1e8-999398f9f6ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.810946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f9b58-3616-4fe1-a1e8-999398f9f6ca None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.819238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 103/208] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/role_assignments?user.id=cec55d5dc7894d74a8143aede7b7706b&scope.project.id=303d80342777404a8a19015531902390&role.id=f095e6999c454c259b2221c8b26d7ae7 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:10.951204 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970314c-2d9e-47eb-a268-34d29ea0f7b0 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:10.951716 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970314c-2d9e-47eb-a268-34d29ea0f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:10.951791 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970314c-2d9e-47eb-a268-34d29ea0f7b0 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:10.953674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 106/209] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:10.959803 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86a48-ad2e-4be9-ac79-6400f8ce69bd None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:10.960708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86a48-ad2e-4be9-ac79-6400f8ce69bd None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:10.961199 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86a48-ad2e-4be9-ac79-6400f8ce69bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:10.980741 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f3b86a48-ad2e-4be9-ac79-6400f8ce69bd None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:10.982282 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f3b86a48-ad2e-4be9-ac79-6400f8ce69bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:11.013245 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:11.039650 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68a7a-0f9c-4af2-ba47-79b0636f1a46 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.040308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68a7a-0f9c-4af2-ba47-79b0636f1a46 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.040794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68a7a-0f9c-4af2-ba47-79b0636f1a46 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.042642 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 107/210] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:11.048377 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5963-d7b2-4a36-9914-9bf5f501ea58 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.048902 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5963-d7b2-4a36-9914-9bf5f501ea58 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.049401 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5963-d7b2-4a36-9914-9bf5f501ea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.059090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 104/211] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:11.074105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-5cdf5963-d7b2-4a36-9914-9bf5f501ea58 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:11.075592 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-5cdf5963-d7b2-4a36-9914-9bf5f501ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:11.151368 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 108/212] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:11.395611 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86a48-ad2e-4be9-ac79-6400f8ce69bd None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:11.488445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf5963-d7b2-4a36-9914-9bf5f501ea58 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:11.506886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86a48-ad2e-4be9-ac79-6400f8ce69bd None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:11.547106 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b75d8-97c0-416c-9223-1ba778fb00eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:11.548673 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b75d8-97c0-416c-9223-1ba778fb00eb None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.549152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b75d8-97c0-416c-9223-1ba778fb00eb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.549662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b75d8-97c0-416c-9223-1ba778fb00eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.563109 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b75d8-97c0-416c-9223-1ba778fb00eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-437b75d8-97c0-416c-9223-1ba778fb00eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:11.569524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:11.570384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:11.571145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:11.573519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 105/213] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:11.581076 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b75d8-97c0-416c-9223-1ba778fb00eb None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:11.602968 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf5963-d7b2-4a36-9914-9bf5f501ea58 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:11.607950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:11.632144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:11.653853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8278e00-b5e2-414a-8977-4362fe4a389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:11.655401 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8278e00-b5e2-414a-8977-4362fe4a389e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.655902 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8278e00-b5e2-414a-8977-4362fe4a389e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.656367 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8278e00-b5e2-414a-8977-4362fe4a389e None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.657735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8278e00-b5e2-414a-8977-4362fe4a389e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:11.660492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8278e00-b5e2-414a-8977-4362fe4a389e None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:11.662332 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 109/214] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:11.672410 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8278e00-b5e2-414a-8977-4362fe4a389e None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:11.706922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b75d8-97c0-416c-9223-1ba778fb00eb None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:11.747565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c297a6e-d1b2-4acc-b694-5d40b106174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:11.748284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297a6e-d1b2-4acc-b694-5d40b106174d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.748572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297a6e-d1b2-4acc-b694-5d40b106174d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.748850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297a6e-d1b2-4acc-b694-5d40b106174d None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.749520 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c297a6e-d1b2-4acc-b694-5d40b106174d None admin] RBAC: Adding query filter params (name=member) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:11.749884 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c297a6e-d1b2-4acc-b694-5d40b106174d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:11.751559 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c297a6e-d1b2-4acc-b694-5d40b106174d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:11.760641 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 106/215] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:11.761943 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7c48-d034-41c3-b013-167bad630b44 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.762232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7c48-d034-41c3-b013-167bad630b44 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.762506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7c48-d034-41c3-b013-167bad630b44 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.763910 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 107/216] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:11.767296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7c48-d034-41c3-b013-167bad630b44 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:11.792819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8278e00-b5e2-414a-8977-4362fe4a389e None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:11.840276 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ee2fc-6fb4-4566-a993-0e39d5a9eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:11.840890 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee2fc-6fb4-4566-a993-0e39d5a9eaba None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.841169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee2fc-6fb4-4566-a993-0e39d5a9eaba None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.841438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee2fc-6fb4-4566-a993-0e39d5a9eaba None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.842450 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ee2fc-6fb4-4566-a993-0e39d5a9eaba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:11.843512 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ee2fc-6fb4-4566-a993-0e39d5a9eaba None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:11.864041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:11.868868 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 110/217] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:11 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:11.870104 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9db95-a520-4c8a-99a4-6f458e253fae None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.870397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9db95-a520-4c8a-99a4-6f458e253fae None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.870658 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9db95-a520-4c8a-99a4-6f458e253fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.893349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-4de9db95-a520-4c8a-99a4-6f458e253fae None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:11.895256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-4de9db95-a520-4c8a-99a4-6f458e253fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:11.897716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7c48-d034-41c3-b013-167bad630b44 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:11.955242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:11.958553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46856679-d8e1-41f0-8e3c-6f61583c04e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:11.960616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46856679-d8e1-41f0-8e3c-6f61583c04e5 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.961584 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46856679-d8e1-41f0-8e3c-6f61583c04e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.962101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46856679-d8e1-41f0-8e3c-6f61583c04e5 None admin] PATH_INFO: `/v3/users/f5b35e661ef7428daa4679236472c046` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.989276 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46856679-d8e1-41f0-8e3c-6f61583c04e5 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b35e661ef7428daa4679236472c046)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:11.990781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46856679-d8e1-41f0-8e3c-6f61583c04e5 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:11.996340 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 108/218] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:11 2022] GET /identity/v3/users/f5b35e661ef7428daa4679236472c046 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:11.998932 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46856679-d8e1-41f0-8e3c-6f61583c04e5 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.001701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 111/219] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:12.122949 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46856679-d8e1-41f0-8e3c-6f61583c04e5 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.158940 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4998d9c-69f5-418d-903d-415926f243d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.160328 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998d9c-69f5-418d-903d-415926f243d0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.160664 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998d9c-69f5-418d-903d-415926f243d0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.160869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998d9c-69f5-418d-903d-415926f243d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.177437 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:12.246083 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4998d9c-69f5-418d-903d-415926f243d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:12.247471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4998d9c-69f5-418d-903d-415926f243d0 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:12.256824 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ae81-815b-4704-9a0c-e58c6449f2c2 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.257415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ae81-815b-4704-9a0c-e58c6449f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.257929 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ae81-815b-4704-9a0c-e58c6449f2c2 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.259293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 112/220] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:12.265754 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c653acb-3d1c-4423-8677-011e20eca596 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.267706 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c653acb-3d1c-4423-8677-011e20eca596 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.269721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c653acb-3d1c-4423-8677-011e20eca596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.291719 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-6c653acb-3d1c-4423-8677-011e20eca596 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:12.292948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-6c653acb-3d1c-4423-8677-011e20eca596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:12.380748 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 113/221] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:12.381876 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c653acb-3d1c-4423-8677-011e20eca596 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.382733 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 109/222] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:12.396898 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4998d9c-69f5-418d-903d-415926f243d0 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.500736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:12.511180 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c653acb-3d1c-4423-8677-011e20eca596 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.514119 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:12.583621 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ada59-9da6-43d9-8f99-594bfcbf5424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.584306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ada59-9da6-43d9-8f99-594bfcbf5424 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.584583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ada59-9da6-43d9-8f99-594bfcbf5424 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.584859 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ada59-9da6-43d9-8f99-594bfcbf5424 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.597762 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4998d9c-69f5-418d-903d-415926f243d0 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.609776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ada59-9da6-43d9-8f99-594bfcbf5424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-154ada59-9da6-43d9-8f99-594bfcbf5424 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:12.615282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:12.616196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:12.616956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 114/223] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:15:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:12.623151 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ada59-9da6-43d9-8f99-594bfcbf5424 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.669332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23a47-8a95-434a-9481-df75361a52b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.669978 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23a47-8a95-434a-9481-df75361a52b7 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.671400 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23a47-8a95-434a-9481-df75361a52b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.671681 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23a47-8a95-434a-9481-df75361a52b7 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.674358 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef23a47-8a95-434a-9481-df75361a52b7 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:12.675916 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef23a47-8a95-434a-9481-df75361a52b7 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:12.677757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 110/224] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:12 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:12.683671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23a47-8a95-434a-9481-df75361a52b7 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.789204 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ada59-9da6-43d9-8f99-594bfcbf5424 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.818950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23a47-8a95-434a-9481-df75361a52b7 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.833243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:12.856549 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.857249 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.857355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.857599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.857938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.858049 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.858218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.858495 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.858889 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] RBAC: Adding query filter params (role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb, user.id=f5b35e661ef7428daa4679236472c046) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:12.859158 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:12.859265 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:12.859460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:12.860849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:12.867438 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 111/225] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:12 2022] GET /identity/v3/role_assignments?user.id=f5b35e661ef7428daa4679236472c046&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:12.869048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:12.884086 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.884613 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 115/226] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:12.886316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.939891 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:13.005997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80cbef-f997-461b-a2a6-c41e2ac78516 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:13.049204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208c09d-cc39-4998-995b-686bcf63e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:13.050953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208c09d-cc39-4998-995b-686bcf63e21a None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:13.051496 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208c09d-cc39-4998-995b-686bcf63e21a None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:13.052021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208c09d-cc39-4998-995b-686bcf63e21a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:13.064974 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208c09d-cc39-4998-995b-686bcf63e21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-3208c09d-cc39-4998-995b-686bcf63e21a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:13.072143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:13.073068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:13.073850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:13.076479 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 112/227] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:13.082515 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208c09d-cc39-4998-995b-686bcf63e21a None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:13.145364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:13.155548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594938d1-369b-4e34-bca3-cc86f63ba3a1 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:13.197462 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f385d1-4a24-4846-bee8-284408d8df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:13.198232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f385d1-4a24-4846-bee8-284408d8df4f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:13.198411 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f385d1-4a24-4846-bee8-284408d8df4f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:13.198631 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f385d1-4a24-4846-bee8-284408d8df4f None admin] PATH_INFO: `/v3/users/b940abc520b44c2bbd3cc5a79174d642` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:13.199858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f385d1-4a24-4846-bee8-284408d8df4f None admin] RBAC: Authorizing `identity:get_user(user_id=b940abc520b44c2bbd3cc5a79174d642)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:13.201270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f385d1-4a24-4846-bee8-284408d8df4f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:13.203175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 116/228] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:12 2022] GET /identity/v3/users/b940abc520b44c2bbd3cc5a79174d642 => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:13.209421 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f385d1-4a24-4846-bee8-284408d8df4f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:13.214078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208c09d-cc39-4998-995b-686bcf63e21a None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:13.282623 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:13.283222 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:13.283500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:13.283766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:13.284564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:13.284864 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:13.286258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:13.305246 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 113/229] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:13.311400 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:13.382491 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:13.390924 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f385d1-4a24-4846-bee8-284408d8df4f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:13.431530 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a125f-45d8-4673-9d2e-67d48d862961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:13.432460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a125f-45d8-4673-9d2e-67d48d862961 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:13.432945 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a125f-45d8-4673-9d2e-67d48d862961 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:13.433352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a125f-45d8-4673-9d2e-67d48d862961 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:13.434761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a125f-45d8-4673-9d2e-67d48d862961 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:13.436672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a125f-45d8-4673-9d2e-67d48d862961 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:13.438821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 117/230] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:13 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:13.448516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a125f-45d8-4673-9d2e-67d48d862961 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:13.523943 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:13.531867 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312b1f0-68b6-478d-99e0-98e19bc0f9a8 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:13.572884 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a125f-45d8-4673-9d2e-67d48d862961 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:13.610057 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28d42-a992-4dcf-b137-c8cc1bddafe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:13.610719 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28d42-a992-4dcf-b137-c8cc1bddafe2 None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:13.611044 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28d42-a992-4dcf-b137-c8cc1bddafe2 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:13.611320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28d42-a992-4dcf-b137-c8cc1bddafe2 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/users/b940abc520b44c2bbd3cc5a79174d642/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:13.614177 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc28d42-a992-4dcf-b137-c8cc1bddafe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf7de8d456645dab44a0fdc611d62bb, user_id=b940abc520b44c2bbd3cc5a79174d642, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:13.615622 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc28d42-a992-4dcf-b137-c8cc1bddafe2 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:13.631425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 118/231] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:15:13 2022] PUT /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/users/b940abc520b44c2bbd3cc5a79174d642/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:13.653307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275717c5-706f-496e-8bfe-44478a77b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:13.653971 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275717c5-706f-496e-8bfe-44478a77b345 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:13.654251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275717c5-706f-496e-8bfe-44478a77b345 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:13.654526 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275717c5-706f-496e-8bfe-44478a77b345 None admin] PATH_INFO: `/v3/users/b940abc520b44c2bbd3cc5a79174d642` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:13.661203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275717c5-706f-496e-8bfe-44478a77b345 None admin] RBAC: Authorizing `identity:get_user(user_id=b940abc520b44c2bbd3cc5a79174d642)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:13.665738 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275717c5-706f-496e-8bfe-44478a77b345 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:13.677193 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 114/232] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:13 2022] GET /identity/v3/users/b940abc520b44c2bbd3cc5a79174d642 => generated 283 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:13.684534 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28d42-a992-4dcf-b137-c8cc1bddafe2 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:13.720240 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:13.816738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28d42-a992-4dcf-b137-c8cc1bddafe2 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:13.854600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2125fc-855f-41b7-bf84-eff7d46cd6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:13.855150 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2125fc-855f-41b7-bf84-eff7d46cd6ec None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:13.855425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2125fc-855f-41b7-bf84-eff7d46cd6ec None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:13.855693 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2125fc-855f-41b7-bf84-eff7d46cd6ec None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:13.856853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2125fc-855f-41b7-bf84-eff7d46cd6ec None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:13.858420 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2125fc-855f-41b7-bf84-eff7d46cd6ec None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:13.860476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 119/233] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:13 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:13.866555 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275717c5-706f-496e-8bfe-44478a77b345 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:14.004894 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275717c5-706f-496e-8bfe-44478a77b345 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:14.042342 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aadf99-738e-44f3-9e0c-368cae6afd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:14.043098 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aadf99-738e-44f3-9e0c-368cae6afd18 None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:14.043361 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aadf99-738e-44f3-9e0c-368cae6afd18 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:14.043639 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aadf99-738e-44f3-9e0c-368cae6afd18 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/users/b940abc520b44c2bbd3cc5a79174d642/roles/bc92a32951104b92b187e6cb51ef9bd8` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:14.046131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aadf99-738e-44f3-9e0c-368cae6afd18 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf7de8d456645dab44a0fdc611d62bb, user_id=b940abc520b44c2bbd3cc5a79174d642, role_id=bc92a32951104b92b187e6cb51ef9bd8)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:14.047569 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aadf99-738e-44f3-9e0c-368cae6afd18 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:14.066457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 115/234] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:15:13 2022] PUT /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/users/b940abc520b44c2bbd3cc5a79174d642/roles/bc92a32951104b92b187e6cb51ef9bd8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:14.662965 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4871993-df1e-4b81-9219-cb051e41ac94 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:14.663475 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4871993-df1e-4b81-9219-cb051e41ac94 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:14.663475 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4871993-df1e-4b81-9219-cb051e41ac94 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:14.664844 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 120/235] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:14.670624 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22351-b2a9-49c2-9cf0-6cfc8104c7d6 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:14.670922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22351-b2a9-49c2-9cf0-6cfc8104c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:14.671197 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22351-b2a9-49c2-9cf0-6cfc8104c7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:14.697185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-77d22351-b2a9-49c2-9cf0-6cfc8104c7d6 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:14.698715 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-77d22351-b2a9-49c2-9cf0-6cfc8104c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:14.728983 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:14.782199 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d670e51-0a3e-43a2-8b51-b426e0fbba0c None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:14.782511 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d670e51-0a3e-43a2-8b51-b426e0fbba0c None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:14.782756 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d670e51-0a3e-43a2-8b51-b426e0fbba0c None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:14.784930 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 121/236] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:14.790083 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3d7b-3596-4174-901c-bad753d08784 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:14.790368 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3d7b-3596-4174-901c-bad753d08784 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:14.790659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3d7b-3596-4174-901c-bad753d08784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:14.792113 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 116/237] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:14.814155 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-fc4d3d7b-3596-4174-901c-bad753d08784 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:14.815958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-fc4d3d7b-3596-4174-901c-bad753d08784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:14.904691 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 122/238] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:15.241007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d22351-b2a9-49c2-9cf0-6cfc8104c7d6 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.343648 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d3d7b-3596-4174-901c-bad753d08784 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.350204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d22351-b2a9-49c2-9cf0-6cfc8104c7d6 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.383006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:15.389911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fa9f-d9c7-4c92-b98d-33ba3de1b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.390555 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fa9f-d9c7-4c92-b98d-33ba3de1b61f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.390829 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fa9f-d9c7-4c92-b98d-33ba3de1b61f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.391267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4fa9f-d9c7-4c92-b98d-33ba3de1b61f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.403426 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4fa9f-d9c7-4c92-b98d-33ba3de1b61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-70d4fa9f-d9c7-4c92-b98d-33ba3de1b61f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:15.408594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:15.410134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:15.410907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:15.418117 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 117/239] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:15.419485 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fa9f-d9c7-4c92-b98d-33ba3de1b61f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.440297 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:15.539269 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4fa9f-d9c7-4c92-b98d-33ba3de1b61f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.578258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.579219 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.579722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.580227 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.581804 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:15.582324 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:15.583935 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:15.589528 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d3d7b-3596-4174-901c-bad753d08784 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.597780 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 118/240] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:15.599253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.664552 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e915828-3016-4da5-9a7a-6400e477dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.665199 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e915828-3016-4da5-9a7a-6400e477dff2 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.665642 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e915828-3016-4da5-9a7a-6400e477dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.666088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e915828-3016-4da5-9a7a-6400e477dff2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.667416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e915828-3016-4da5-9a7a-6400e477dff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:15.669133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e915828-3016-4da5-9a7a-6400e477dff2 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:15.676322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 123/241] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:15.680842 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e915828-3016-4da5-9a7a-6400e477dff2 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.704404 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:15.718397 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbf5b5-9895-4897-a312-583e9bbcd139 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.756928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf6851-5050-486c-bded-1f9eea4ae78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.757662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf6851-5050-486c-bded-1f9eea4ae78e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.757935 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf6851-5050-486c-bded-1f9eea4ae78e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.758206 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf6851-5050-486c-bded-1f9eea4ae78e None admin] PATH_INFO: `/v3/users/6c3ff3fa1f934e54971df10886a104d3` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.774797 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf6851-5050-486c-bded-1f9eea4ae78e None admin] RBAC: Authorizing `identity:get_user(user_id=6c3ff3fa1f934e54971df10886a104d3)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:15.776454 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf6851-5050-486c-bded-1f9eea4ae78e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:15.778418 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 119/242] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:15 2022] GET /identity/v3/users/6c3ff3fa1f934e54971df10886a104d3 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:15.779713 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267f68-61c6-4633-a7cc-fc7a166b78ee None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.780024 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267f68-61c6-4633-a7cc-fc7a166b78ee None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.780293 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267f68-61c6-4633-a7cc-fc7a166b78ee None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.781631 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 120/243] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:15.786894 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267f68-61c6-4633-a7cc-fc7a166b78ee None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.813721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:15.829189 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e915828-3016-4da5-9a7a-6400e477dff2 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.868405 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c14a-5c6f-40cc-a509-7a235ddf6712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.869069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c14a-5c6f-40cc-a509-7a235ddf6712 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.869520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c14a-5c6f-40cc-a509-7a235ddf6712 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.869920 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c14a-5c6f-40cc-a509-7a235ddf6712 None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.870690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63c14a-5c6f-40cc-a509-7a235ddf6712 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:15.872334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63c14a-5c6f-40cc-a509-7a235ddf6712 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:15.897608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 124/244] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:15 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:15.903856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4f90-0195-4f0a-af05-ef6f1238262f None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.903856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4f90-0195-4f0a-af05-ef6f1238262f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.903856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4f90-0195-4f0a-af05-ef6f1238262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.913653 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267f68-61c6-4633-a7cc-fc7a166b78ee None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.928258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-01ca4f90-0195-4f0a-af05-ef6f1238262f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:15.928258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-01ca4f90-0195-4f0a-af05-ef6f1238262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:15.977033 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4acf6-6f4b-42b6-aef2-9ad3f32303b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.977961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4acf6-6f4b-42b6-aef2-9ad3f32303b4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.978375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4acf6-6f4b-42b6-aef2-9ad3f32303b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.978801 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4acf6-6f4b-42b6-aef2-9ad3f32303b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.988692 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:16.008219 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 125/245] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:16.094937 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4acf6-6f4b-42b6-aef2-9ad3f32303b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:16.096678 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4acf6-6f4b-42b6-aef2-9ad3f32303b4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:16.217351 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 121/246] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:16.223970 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4f90-0195-4f0a-af05-ef6f1238262f None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:16.318650 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:16.346009 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4f90-0195-4f0a-af05-ef6f1238262f None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:16.390893 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27921a4-bddf-4dbb-b4a6-06b3c16858ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:16.391664 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27921a4-bddf-4dbb-b4a6-06b3c16858ab None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:16.391997 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27921a4-bddf-4dbb-b4a6-06b3c16858ab None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:16.392276 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27921a4-bddf-4dbb-b4a6-06b3c16858ab None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:16.394061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27921a4-bddf-4dbb-b4a6-06b3c16858ab None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:16.395786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27921a4-bddf-4dbb-b4a6-06b3c16858ab None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:16.397621 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 126/247] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:16 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:16.403663 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4acf6-6f4b-42b6-aef2-9ad3f32303b4 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:16.436804 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27921a4-bddf-4dbb-b4a6-06b3c16858ab None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:16.456663 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:16.554679 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4acf6-6f4b-42b6-aef2-9ad3f32303b4 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:16.573839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27921a4-bddf-4dbb-b4a6-06b3c16858ab None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:16.604128 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0528314-f724-45ca-b489-234244808620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:16.604968 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0528314-f724-45ca-b489-234244808620 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:16.605253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0528314-f724-45ca-b489-234244808620 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:16.605529 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0528314-f724-45ca-b489-234244808620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:16.606263 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0528314-f724-45ca-b489-234244808620 None admin] RBAC: Adding query filter params (role.id=f095e6999c454c259b2221c8b26d7ae7, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb, user.id=6c3ff3fa1f934e54971df10886a104d3) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:16.606571 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0528314-f724-45ca-b489-234244808620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:16.608060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0528314-f724-45ca-b489-234244808620 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:16.617522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 122/248] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:16 2022] GET /identity/v3/role_assignments?user.id=6c3ff3fa1f934e54971df10886a104d3&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=f095e6999c454c259b2221c8b26d7ae7 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:16.619015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915302-ad04-46d2-9035-17578af5a72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:16.619302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7dfa-a37e-4ac1-9849-73f2e64d5a36 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:16.619759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7dfa-a37e-4ac1-9849-73f2e64d5a36 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:16.619882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915302-ad04-46d2-9035-17578af5a72f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:16.620205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915302-ad04-46d2-9035-17578af5a72f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:16.620548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915302-ad04-46d2-9035-17578af5a72f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:16.620660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7dfa-a37e-4ac1-9849-73f2e64d5a36 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:16.622475 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 123/249] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:16.630352 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6bac2-8c61-41c3-a024-7c941b278406 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:16.630914 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6bac2-8c61-41c3-a024-7c941b278406 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:16.631364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6bac2-8c61-41c3-a024-7c941b278406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:16.633605 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62915302-ad04-46d2-9035-17578af5a72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-62915302-ad04-46d2-9035-17578af5a72f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:16.638617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:16.639733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:16.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:16.641307 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 127/250] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:16.647721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915302-ad04-46d2-9035-17578af5a72f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:16.654321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:16.672056 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-5ed6bac2-8c61-41c3-a024-7c941b278406 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:16.673686 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-5ed6bac2-8c61-41c3-a024-7c941b278406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:16.804448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 124/251] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:16.812897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915302-ad04-46d2-9035-17578af5a72f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:16.856208 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be51657-c6cd-41ff-b2cb-63703250b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:16.856765 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51657-c6cd-41ff-b2cb-63703250b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:16.857046 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51657-c6cd-41ff-b2cb-63703250b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:16.857321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51657-c6cd-41ff-b2cb-63703250b4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:16.858066 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be51657-c6cd-41ff-b2cb-63703250b4c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:16.858308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be51657-c6cd-41ff-b2cb-63703250b4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:16.859717 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be51657-c6cd-41ff-b2cb-63703250b4c9 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:16.869942 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 128/252] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:16.875745 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6bac2-8c61-41c3-a024-7c941b278406 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:16.911871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:16.984368 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450590a2-3548-4764-90d6-353caa55c811 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:16.984935 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450590a2-3548-4764-90d6-353caa55c811 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:16.985417 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450590a2-3548-4764-90d6-353caa55c811 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:16.987234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 129/253] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:16.989435 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6bac2-8c61-41c3-a024-7c941b278406 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:16.993152 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9902-8f00-4d21-9310-197f18b0feb6 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:16.993671 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9902-8f00-4d21-9310-197f18b0feb6 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:16.994290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9902-8f00-4d21-9310-197f18b0feb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.031866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770d133-9e75-4325-af10-1adaee998e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:17.031866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d133-9e75-4325-af10-1adaee998e6f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:17.031866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d133-9e75-4325-af10-1adaee998e6f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:17.031866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d133-9e75-4325-af10-1adaee998e6f None admin] PATH_INFO: `/v3/users/f5b35e661ef7428daa4679236472c046` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.032298 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770d133-9e75-4325-af10-1adaee998e6f None admin] RBAC: Authorizing `identity:get_user(user_id=f5b35e661ef7428daa4679236472c046)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:17.032298 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770d133-9e75-4325-af10-1adaee998e6f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:17.032298 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 125/254] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:16 2022] GET /identity/v3/users/f5b35e661ef7428daa4679236472c046 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:17.033931 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-724d9902-8f00-4d21-9310-197f18b0feb6 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:17.035441 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-724d9902-8f00-4d21-9310-197f18b0feb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:17.039553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770d133-9e75-4325-af10-1adaee998e6f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:17.130059 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:17.145053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 130/255] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:17.154796 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:17.158682 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770d133-9e75-4325-af10-1adaee998e6f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:17.197982 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2fa25-77c6-427c-9635-bcfa38a7581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:17.198665 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2fa25-77c6-427c-9635-bcfa38a7581f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:17.198945 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2fa25-77c6-427c-9635-bcfa38a7581f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:17.199214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2fa25-77c6-427c-9635-bcfa38a7581f None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.200381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2fa25-77c6-427c-9635-bcfa38a7581f None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:17.201808 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2fa25-77c6-427c-9635-bcfa38a7581f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:17.203883 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 126/256] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:17 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:17.210959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d9902-8f00-4d21-9310-197f18b0feb6 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:17.330040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2fa25-77c6-427c-9635-bcfa38a7581f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:17.344021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d9902-8f00-4d21-9310-197f18b0feb6 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:17.389390 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe0ab6-a564-48f5-a689-a57dd59b194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:17.391038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0ab6-a564-48f5-a689-a57dd59b194c None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:17.391731 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0ab6-a564-48f5-a689-a57dd59b194c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:17.392234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0ab6-a564-48f5-a689-a57dd59b194c None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/users/f5b35e661ef7428daa4679236472c046/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.404088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe0ab6-a564-48f5-a689-a57dd59b194c None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf7de8d456645dab44a0fdc611d62bb, user_id=f5b35e661ef7428daa4679236472c046, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:17.405963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe0ab6-a564-48f5-a689-a57dd59b194c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:17.434160 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 131/257] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:15:17 2022] PUT /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/users/f5b35e661ef7428daa4679236472c046/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:17.527843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2fa25-77c6-427c-9635-bcfa38a7581f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:17.574476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6b00d-5a65-4cb7-b2c1-f98323e19fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:17.575116 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6b00d-5a65-4cb7-b2c1-f98323e19fb0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:17.575399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6b00d-5a65-4cb7-b2c1-f98323e19fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:17.575673 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6b00d-5a65-4cb7-b2c1-f98323e19fb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.595253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6b00d-5a65-4cb7-b2c1-f98323e19fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-22c6b00d-5a65-4cb7-b2c1-f98323e19fb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:17.601084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:17.601975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:17.602786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:17.603385 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 127/258] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:17.608239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe0ab6-a564-48f5-a689-a57dd59b194c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:17.654200 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6b00d-5a65-4cb7-b2c1-f98323e19fb0 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:17.694844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:17.732227 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:17.791581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe0ab6-a564-48f5-a689-a57dd59b194c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:17.831936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:17.833383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:17.833913 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:17.834383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.835263 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:17.835786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:17.837404 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:17.847525 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 132/259] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:17.854050 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:17.865691 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6b00d-5a65-4cb7-b2c1-f98323e19fb0 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:17.956231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332b30c-6bc1-434a-9e46-605710a97c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:17.956767 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b30c-6bc1-434a-9e46-605710a97c84 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:17.957048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b30c-6bc1-434a-9e46-605710a97c84 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:17.957324 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b30c-6bc1-434a-9e46-605710a97c84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.970810 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de4133-95e7-412e-b646-f9b250b1c4e2 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:17.988811 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332b30c-6bc1-434a-9e46-605710a97c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:17.990340 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-b332b30c-6bc1-434a-9e46-605710a97c84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:17.993899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:17.994774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:17.995612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:18.000739 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 128/260] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:18.006203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332b30c-6bc1-434a-9e46-605710a97c84 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.020113 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a5729-d882-443b-81c2-7cb5950f6290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.021068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a5729-d882-443b-81c2-7cb5950f6290 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.021550 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a5729-d882-443b-81c2-7cb5950f6290 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.022077 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a5729-d882-443b-81c2-7cb5950f6290 None admin] PATH_INFO: `/v3/users/b940abc520b44c2bbd3cc5a79174d642` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.023464 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a5729-d882-443b-81c2-7cb5950f6290 None admin] RBAC: Authorizing `identity:get_user(user_id=b940abc520b44c2bbd3cc5a79174d642)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.025143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a5729-d882-443b-81c2-7cb5950f6290 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.027242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 133/261] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:17 2022] GET /identity/v3/users/b940abc520b44c2bbd3cc5a79174d642 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:18.033232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a5729-d882-443b-81c2-7cb5950f6290 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.195393 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:18.226911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332b30c-6bc1-434a-9e46-605710a97c84 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.230958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a5729-d882-443b-81c2-7cb5950f6290 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.271403 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.272411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.273338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.273839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.274714 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:18.275216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.276990 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.287620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 129/262] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:18.293919 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.308513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c7b9e-7318-4b51-b892-f89c711e7249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.309482 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7b9e-7318-4b51-b892-f89c711e7249 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.309957 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7b9e-7318-4b51-b892-f89c711e7249 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.310425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7b9e-7318-4b51-b892-f89c711e7249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.384595 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:18.409359 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c7b9e-7318-4b51-b892-f89c711e7249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.411111 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c7b9e-7318-4b51-b892-f89c711e7249 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.465204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d22d-52b1-4455-a3de-9e5f80630d7f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.544534 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdab321-059f-44c6-bcde-b520a676ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.545188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab321-059f-44c6-bcde-b520a676ad6c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.545735 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab321-059f-44c6-bcde-b520a676ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.545965 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab321-059f-44c6-bcde-b520a676ad6c None admin] PATH_INFO: `/v3/users/b940abc520b44c2bbd3cc5a79174d642` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.547139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdab321-059f-44c6-bcde-b520a676ad6c None admin] RBAC: Authorizing `identity:get_user(user_id=b940abc520b44c2bbd3cc5a79174d642)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.548614 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdab321-059f-44c6-bcde-b520a676ad6c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.550741 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 130/264] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/users/b940abc520b44c2bbd3cc5a79174d642 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:18.550857 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 134/264] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:18.556605 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdab321-059f-44c6-bcde-b520a676ad6c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.556732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c7b9e-7318-4b51-b892-f89c711e7249 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.618369 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:18.719336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:18.747643 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c7b9e-7318-4b51-b892-f89c711e7249 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.837938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdab321-059f-44c6-bcde-b520a676ad6c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.849228 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bacd35-1340-4303-861a-1b2aeb4a955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.849999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bacd35-1340-4303-861a-1b2aeb4a955a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.850147 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bacd35-1340-4303-861a-1b2aeb4a955a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.850453 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bacd35-1340-4303-861a-1b2aeb4a955a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.937130 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5ebbb-68d7-42b6-8a44-99a7803a4723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.937772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ebbb-68d7-42b6-8a44-99a7803a4723 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.938053 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ebbb-68d7-42b6-8a44-99a7803a4723 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.938327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ebbb-68d7-42b6-8a44-99a7803a4723 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.939452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5ebbb-68d7-42b6-8a44-99a7803a4723 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.941741 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5ebbb-68d7-42b6-8a44-99a7803a4723 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.943378 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 131/265] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:18.952020 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5ebbb-68d7-42b6-8a44-99a7803a4723 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.998035 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bacd35-1340-4303-861a-1b2aeb4a955a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.999425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bacd35-1340-4303-861a-1b2aeb4a955a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:19.204327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:19.245713 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5ebbb-68d7-42b6-8a44-99a7803a4723 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:19.303664 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:19.304316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:19.304606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:19.305256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:19.305622 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb, user.id=b940abc520b44c2bbd3cc5a79174d642) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:19.305938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:19.307401 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:19.314411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 132/266] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/role_assignments?user.id=b940abc520b44c2bbd3cc5a79174d642&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=952eea31fada4104858d315ac0f1296a => generated 608 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:19.336233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:19.360711 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 135/267] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:19.367524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:19.516304 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240eeed-05c2-42e8-b664-d54f9b517e92 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:19.560952 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd0a95-fe5a-40f8-b5b0-51216ee9a3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:19.561555 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd0a95-fe5a-40f8-b5b0-51216ee9a3f0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:19.561761 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd0a95-fe5a-40f8-b5b0-51216ee9a3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:19.562025 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd0a95-fe5a-40f8-b5b0-51216ee9a3f0 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:19.563164 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd0a95-fe5a-40f8-b5b0-51216ee9a3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:19.564702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd0a95-fe5a-40f8-b5b0-51216ee9a3f0 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:19.567114 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 133/268] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:19 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:19.573105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bacd35-1340-4303-861a-1b2aeb4a955a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:19.725228 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bacd35-1340-4303-861a-1b2aeb4a955a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:19.776869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6bcd9-acc1-478b-81f6-5f84a5ee8691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:19.777511 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6bcd9-acc1-478b-81f6-5f84a5ee8691 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:19.777788 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6bcd9-acc1-478b-81f6-5f84a5ee8691 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:19.778034 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6bcd9-acc1-478b-81f6-5f84a5ee8691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:19.778771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6bcd9-acc1-478b-81f6-5f84a5ee8691 None admin] RBAC: Adding query filter params (role.id=bc92a32951104b92b187e6cb51ef9bd8, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb, user.id=b940abc520b44c2bbd3cc5a79174d642) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:19.779079 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6bcd9-acc1-478b-81f6-5f84a5ee8691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:19.780545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6bcd9-acc1-478b-81f6-5f84a5ee8691 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:19.787941 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 136/269] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:19 2022] GET /identity/v3/role_assignments?user.id=b940abc520b44c2bbd3cc5a79174d642&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=bc92a32951104b92b187e6cb51ef9bd8 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:19.920076 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f9b9-7db2-4a87-b765-100a8fda2396 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:19.920881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f9b9-7db2-4a87-b765-100a8fda2396 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:19.921380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f9b9-7db2-4a87-b765-100a8fda2396 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:19.922936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 134/270] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:19.930291 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5adc-2afe-475f-a07a-405a1f861a8d None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:19.931189 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5adc-2afe-475f-a07a-405a1f861a8d None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:19.931623 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5adc-2afe-475f-a07a-405a1f861a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:19.954516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-2b8b5adc-2afe-475f-a07a-405a1f861a8d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:19.956804 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-2b8b5adc-2afe-475f-a07a-405a1f861a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:20.009722 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:20.040144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 137/271] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:20.315119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d4f9-768c-4909-8bc5-9cf441846b79 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.315410 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d4f9-768c-4909-8bc5-9cf441846b79 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.315797 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d4f9-768c-4909-8bc5-9cf441846b79 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.317202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 135/272] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:20.322366 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac19d7-15a8-4cf0-a2af-8ccbebde6130 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.322649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac19d7-15a8-4cf0-a2af-8ccbebde6130 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.322924 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac19d7-15a8-4cf0-a2af-8ccbebde6130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.341464 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-74ac19d7-15a8-4cf0-a2af-8ccbebde6130 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:20.342653 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-74ac19d7-15a8-4cf0-a2af-8ccbebde6130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:20.403249 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51202b41-4175-4e1a-8597-c2c4e7ab6e07 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.403540 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51202b41-4175-4e1a-8597-c2c4e7ab6e07 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.403818 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51202b41-4175-4e1a-8597-c2c4e7ab6e07 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.405325 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 136/273] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:20.412314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31058d-5db5-408a-9224-329fe216e050 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.412693 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31058d-5db5-408a-9224-329fe216e050 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.413041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31058d-5db5-408a-9224-329fe216e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.434709 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 138/274] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:20.438115 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac19d7-15a8-4cf0-a2af-8ccbebde6130 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:20.447174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-5a31058d-5db5-408a-9224-329fe216e050 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:20.448403 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-5a31058d-5db5-408a-9224-329fe216e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:20.463940 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:20.534726 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 137/275] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:20.577257 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac19d7-15a8-4cf0-a2af-8ccbebde6130 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:20.589444 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:20.617540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a281f-98f3-47a6-af00-42cb5c702227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:20.618537 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a281f-98f3-47a6-af00-42cb5c702227 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.619061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a281f-98f3-47a6-af00-42cb5c702227 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.619553 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a281f-98f3-47a6-af00-42cb5c702227 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.630763 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a281f-98f3-47a6-af00-42cb5c702227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-de5a281f-98f3-47a6-af00-42cb5c702227 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:20.635809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:20.636684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:20.637460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:20.639690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 139/276] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:20.648504 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31058d-5db5-408a-9224-329fe216e050 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:20.726877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fa9a-a8af-44bf-a049-839329ffa6bf None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.727521 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fa9a-a8af-44bf-a049-839329ffa6bf None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.728037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fa9a-a8af-44bf-a049-839329ffa6bf None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.730386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 140/277] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:20.736172 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bb70-ed40-4265-a309-2a9388d507bf None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.736452 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bb70-ed40-4265-a309-2a9388d507bf None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.736750 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bb70-ed40-4265-a309-2a9388d507bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.755999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-45b5bb70-ed40-4265-a309-2a9388d507bf None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:20.757183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-45b5bb70-ed40-4265-a309-2a9388d507bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:20.758229 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31058d-5db5-408a-9224-329fe216e050 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:20.793891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:20.794487 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.794758 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.795023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.796046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] RBAC: Adding query filter params (name=member) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:20.796344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:20.797713 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:20.806239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 138/278] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:20.811746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:20.823469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:20.833523 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 141/279] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:20.834607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5bb70-ed40-4265-a309-2a9388d507bf None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:20.933415 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f9e3b-6284-4656-8660-89076dbefc21 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:20.934503 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:20.938535 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5bb70-ed40-4265-a309-2a9388d507bf None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:20.975585 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44939334-5b5d-4caf-bd4a-4e9f5ed7d5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:20.976236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44939334-5b5d-4caf-bd4a-4e9f5ed7d5c3 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.976511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44939334-5b5d-4caf-bd4a-4e9f5ed7d5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.976777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44939334-5b5d-4caf-bd4a-4e9f5ed7d5c3 None admin] PATH_INFO: `/v3/users/cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.979779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe05a-eb2e-48cc-a9be-89e44a7b212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:20.980431 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe05a-eb2e-48cc-a9be-89e44a7b212d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:20.980708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe05a-eb2e-48cc-a9be-89e44a7b212d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:20.980976 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe05a-eb2e-48cc-a9be-89e44a7b212d None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:20.982067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe05a-eb2e-48cc-a9be-89e44a7b212d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:20.983540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe05a-eb2e-48cc-a9be-89e44a7b212d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:20.985172 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 142/280] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:20.986041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe05a-eb2e-48cc-a9be-89e44a7b212d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:20.993976 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44939334-5b5d-4caf-bd4a-4e9f5ed7d5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:20.995936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44939334-5b5d-4caf-bd4a-4e9f5ed7d5c3 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:21.002238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 139/281] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:20 2022] GET /identity/v3/users/cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:21.003980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44939334-5b5d-4caf-bd4a-4e9f5ed7d5c3 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.077048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:21.102067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe05a-eb2e-48cc-a9be-89e44a7b212d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:21.119013 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44939334-5b5d-4caf-bd4a-4e9f5ed7d5c3 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:21.141904 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5216a6-6b28-4585-a69d-6c7b56beff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:21.142529 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5216a6-6b28-4585-a69d-6c7b56beff14 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:21.142807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5216a6-6b28-4585-a69d-6c7b56beff14 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:21.143198 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5216a6-6b28-4585-a69d-6c7b56beff14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:21.153652 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5216a6-6b28-4585-a69d-6c7b56beff14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:21.155922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee49a-7e37-470c-8e77-a824c5040433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:21.156523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee49a-7e37-470c-8e77-a824c5040433 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:21.156801 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee49a-7e37-470c-8e77-a824c5040433 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:21.157075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee49a-7e37-470c-8e77-a824c5040433 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:21.157707 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bee49a-7e37-470c-8e77-a824c5040433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:21.159139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bee49a-7e37-470c-8e77-a824c5040433 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-0a5216a6-6b28-4585-a69d-6c7b56beff14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:21.159526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:21.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:21.161288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:21.165658 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 143/282] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:21.166526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5216a6-6b28-4585-a69d-6c7b56beff14 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.197549 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 140/283] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:21 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:21.197549 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee49a-7e37-470c-8e77-a824c5040433 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.201548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:21.294123 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5216a6-6b28-4585-a69d-6c7b56beff14 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:21.325086 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee49a-7e37-470c-8e77-a824c5040433 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:21.333009 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:21.334227 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:21.334518 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:21.334789 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:21.335534 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] RBAC: Adding query filter params (role.id=811019b55bad4d3982f2f845fd434eb4, user.id=cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4, scope.system=all) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:21.335885 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:21.338071 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:21.343536 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 144/284] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 24 00:15:21 2022] GET /identity/v3/role_assignments?user.id=cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4&scope.system=all&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:21.349066 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.353310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:21.376249 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:21.377173 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:21.377490 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:21.377768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:21.378709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:21.379024 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:21.380906 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:21.392764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 141/285] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:21.401170 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.490100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:21.502028 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478fa8-c82a-416a-ad8c-e89c50e16878 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:21.534145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910ff1e-9031-480f-98da-95fd71794db7 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:21.557157 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61a07a-7fb7-41cb-bb29-87f758ba9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:21.557808 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a07a-7fb7-41cb-bb29-87f758ba9acc None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:21.558090 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a07a-7fb7-41cb-bb29-87f758ba9acc None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:21.558801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a07a-7fb7-41cb-bb29-87f758ba9acc None admin] PATH_INFO: `/v3/roles/member` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:21.576813 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66933-446c-4658-bd69-a6e9e1976df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:21.577214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61a07a-7fb7-41cb-bb29-87f758ba9acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:21.578013 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66933-446c-4658-bd69-a6e9e1976df0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:21.578487 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66933-446c-4658-bd69-a6e9e1976df0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:21.578963 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66933-446c-4658-bd69-a6e9e1976df0 None admin] PATH_INFO: `/v3/users/6c3ff3fa1f934e54971df10886a104d3` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:21.581567 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66933-446c-4658-bd69-a6e9e1976df0 None admin] RBAC: Authorizing `identity:get_user(user_id=6c3ff3fa1f934e54971df10886a104d3)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:21.583066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66933-446c-4658-bd69-a6e9e1976df0 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-5e61a07a-7fb7-41cb-bb29-87f758ba9acc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:21.583175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:21.584030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:21.584799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 145/286] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:21.586214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 142/287] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:21 2022] GET /identity/v3/users/6c3ff3fa1f934e54971df10886a104d3 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:21.590562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61a07a-7fb7-41cb-bb29-87f758ba9acc None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.592211 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66933-446c-4658-bd69-a6e9e1976df0 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.661583 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:21.761661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66933-446c-4658-bd69-a6e9e1976df0 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:21.765370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61a07a-7fb7-41cb-bb29-87f758ba9acc None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:21.811982 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e54893-108e-44cb-90ad-f5a90d6efe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:21.812625 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e54893-108e-44cb-90ad-f5a90d6efe51 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:21.812905 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e54893-108e-44cb-90ad-f5a90d6efe51 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:21.813176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e54893-108e-44cb-90ad-f5a90d6efe51 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:21.818692 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e54893-108e-44cb-90ad-f5a90d6efe51 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:21.820209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e54893-108e-44cb-90ad-f5a90d6efe51 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:21.821910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 146/288] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:21 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:21.828172 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e54893-108e-44cb-90ad-f5a90d6efe51 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.850653 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:21.852413 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:21.852706 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:21.852987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:21.853678 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] RBAC: Adding query filter params (name=member) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:21.853978 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:21.855373 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:21.868761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:21.872013 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 143/289] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:21.880831 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:21.965470 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e54893-108e-44cb-90ad-f5a90d6efe51 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:22.044390 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b282345-d2a9-420e-8ebd-709c5c91f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:22.045064 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282345-d2a9-420e-8ebd-709c5c91f2da None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:22.045608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282345-d2a9-420e-8ebd-709c5c91f2da None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:22.045878 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282345-d2a9-420e-8ebd-709c5c91f2da None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/users/6c3ff3fa1f934e54971df10886a104d3/roles/f095e6999c454c259b2221c8b26d7ae7` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:22.048162 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d953a5c-0920-4848-9e62-3b3d218b421c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:22.053146 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b282345-d2a9-420e-8ebd-709c5c91f2da None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf7de8d456645dab44a0fdc611d62bb, user_id=6c3ff3fa1f934e54971df10886a104d3, role_id=f095e6999c454c259b2221c8b26d7ae7)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:22.054668 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b282345-d2a9-420e-8ebd-709c5c91f2da None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:22.066758 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:22.077236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 147/290] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:15:21 2022] PUT /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/users/6c3ff3fa1f934e54971df10886a104d3/roles/f095e6999c454c259b2221c8b26d7ae7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:22.084359 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799f32-465f-4d29-a644-c871c1e29f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:22.085301 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f32-465f-4d29-a644-c871c1e29f8c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:22.085812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f32-465f-4d29-a644-c871c1e29f8c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:22.086381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799f32-465f-4d29-a644-c871c1e29f8c None admin] PATH_INFO: `/v3/users/f5b35e661ef7428daa4679236472c046` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:22.087744 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799f32-465f-4d29-a644-c871c1e29f8c None admin] RBAC: Authorizing `identity:get_user(user_id=f5b35e661ef7428daa4679236472c046)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:22.089535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799f32-465f-4d29-a644-c871c1e29f8c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:22.092117 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 144/291] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:21 2022] GET /identity/v3/users/f5b35e661ef7428daa4679236472c046 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:22.097035 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b282345-d2a9-420e-8ebd-709c5c91f2da None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:22.184788 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:22.222482 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b282345-d2a9-420e-8ebd-709c5c91f2da None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:22.270176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d1bc-b836-4dba-9465-65d02a917349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:22.270849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d1bc-b836-4dba-9465-65d02a917349 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:22.271129 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d1bc-b836-4dba-9465-65d02a917349 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:22.271396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d1bc-b836-4dba-9465-65d02a917349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:22.369680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4d1bc-b836-4dba-9465-65d02a917349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:22.371214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4d1bc-b836-4dba-9465-65d02a917349 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:22.456681 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:22.483893 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 148/292] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:22.487648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799f32-465f-4d29-a644-c871c1e29f8c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:22.595856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799f32-465f-4d29-a644-c871c1e29f8c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:22.632198 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9dea-0e80-4a22-8dfe-74d67d7ed9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:22.632844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9dea-0e80-4a22-8dfe-74d67d7ed9bb None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:22.633120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9dea-0e80-4a22-8dfe-74d67d7ed9bb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:22.633392 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9dea-0e80-4a22-8dfe-74d67d7ed9bb None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:22.634631 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f9dea-0e80-4a22-8dfe-74d67d7ed9bb None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:22.636136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f9dea-0e80-4a22-8dfe-74d67d7ed9bb None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:22.638170 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 145/293] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:22 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:22.644881 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d1bc-b836-4dba-9465-65d02a917349 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:22.750372 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d1bc-b836-4dba-9465-65d02a917349 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:22.787712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121ae22-195a-436d-a645-e007f25be2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:22.788345 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ae22-195a-436d-a645-e007f25be2de None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:22.788670 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ae22-195a-436d-a645-e007f25be2de None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:22.789002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ae22-195a-436d-a645-e007f25be2de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:22.789729 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121ae22-195a-436d-a645-e007f25be2de None admin] RBAC: Adding query filter params (role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb, user.id=f5b35e661ef7428daa4679236472c046) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:22.790077 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121ae22-195a-436d-a645-e007f25be2de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:22.791631 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121ae22-195a-436d-a645-e007f25be2de None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:22.798110 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 149/294] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:22 2022] GET /identity/v3/role_assignments?user.id=f5b35e661ef7428daa4679236472c046&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:23.851421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fee22-df2f-453f-a6c0-907970a93c79 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:23.852508 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fee22-df2f-453f-a6c0-907970a93c79 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:23.852992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fee22-df2f-453f-a6c0-907970a93c79 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:23.854811 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 146/295] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:23.860303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135545b-e478-49f2-9637-88e541bebdcf None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:23.861097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135545b-e478-49f2-9637-88e541bebdcf None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:23.861626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135545b-e478-49f2-9637-88e541bebdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:23.881815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-6135545b-e478-49f2-9637-88e541bebdcf None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:23.883477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-6135545b-e478-49f2-9637-88e541bebdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:23.928210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:23.962280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 150/296] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:23.981330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045497d9-d451-42e0-ab69-7269e2416b96 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:23.981899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045497d9-d451-42e0-ab69-7269e2416b96 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:23.982371 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045497d9-d451-42e0-ab69-7269e2416b96 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:23.984196 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 147/297] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:23.989814 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff784b-5cdd-4212-b75a-b3559befd7f8 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:23.990101 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff784b-5cdd-4212-b75a-b3559befd7f8 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:23.990375 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff784b-5cdd-4212-b75a-b3559befd7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.009920 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-9cff784b-5cdd-4212-b75a-b3559befd7f8 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:24.011109 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-9cff784b-5cdd-4212-b75a-b3559befd7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:24.060174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411da6-5114-400a-a045-f4320ed19347 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.060817 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411da6-5114-400a-a045-f4320ed19347 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.061294 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411da6-5114-400a-a045-f4320ed19347 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.062837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 148/298] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:15:24.068320 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1c22-445b-4715-9801-d6472d3dcea8 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.068610 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1c22-445b-4715-9801-d6472d3dcea8 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.068890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1c22-445b-4715-9801-d6472d3dcea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.082047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 151/299] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:24.087956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-030b1c22-445b-4715-9801-d6472d3dcea8 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:24.089160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-030b1c22-445b-4715-9801-d6472d3dcea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:24.138046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:24.168155 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 149/300] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:24.323596 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff784b-5cdd-4212-b75a-b3559befd7f8 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:24.432005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b1c22-445b-4715-9801-d6472d3dcea8 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:24.432961 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff784b-5cdd-4212-b75a-b3559befd7f8 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:24.434507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:24.469787 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c03e3-76b0-4d0d-9e75-b4afa5097d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:24.470417 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c03e3-76b0-4d0d-9e75-b4afa5097d0e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.470690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c03e3-76b0-4d0d-9e75-b4afa5097d0e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.471018 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c03e3-76b0-4d0d-9e75-b4afa5097d0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.493069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c03e3-76b0-4d0d-9e75-b4afa5097d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-5d4c03e3-76b0-4d0d-9e75-b4afa5097d0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:24.498474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:24.499319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:24.500161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:24.508182 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 152/301] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:24.508990 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c03e3-76b0-4d0d-9e75-b4afa5097d0e None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:24.557778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b1c22-445b-4715-9801-d6472d3dcea8 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:24.599267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50716-400b-4d3a-86b1-7f85af48022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:24.599925 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50716-400b-4d3a-86b1-7f85af48022b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.600209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50716-400b-4d3a-86b1-7f85af48022b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.600481 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50716-400b-4d3a-86b1-7f85af48022b None admin] PATH_INFO: `/v3/domains/default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.601589 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50716-400b-4d3a-86b1-7f85af48022b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:24.603037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50716-400b-4d3a-86b1-7f85af48022b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:24.610145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 150/302] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:24.610145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50716-400b-4d3a-86b1-7f85af48022b None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:24.629979 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c03e3-76b0-4d0d-9e75-b4afa5097d0e None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:24.660479 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:24.668146 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ece3a1-0554-492c-90cb-10fdcd297d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:24.668799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ece3a1-0554-492c-90cb-10fdcd297d70 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.669080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ece3a1-0554-492c-90cb-10fdcd297d70 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.669359 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ece3a1-0554-492c-90cb-10fdcd297d70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.681288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ece3a1-0554-492c-90cb-10fdcd297d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-a4ece3a1-0554-492c-90cb-10fdcd297d70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:24.686145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:24.687025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:24.688149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 153/303] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:24.693522 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ece3a1-0554-492c-90cb-10fdcd297d70 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:24.718405 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:24.722370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50716-400b-4d3a-86b1-7f85af48022b None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:24.758963 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:24.759560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.759852 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.760130 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.760811 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] RBAC: Adding query filter params (name=member) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:24.761533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:24.762527 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:24.778666 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 151/304] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:24.778666 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:24.811264 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ece3a1-0554-492c-90cb-10fdcd297d70 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:24.848627 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755fea8-05fa-48ae-b132-a448c90e26d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:24.849238 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755fea8-05fa-48ae-b132-a448c90e26d1 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.849513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755fea8-05fa-48ae-b132-a448c90e26d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.849783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755fea8-05fa-48ae-b132-a448c90e26d1 None admin] PATH_INFO: `/v3/groups` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.850399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755fea8-05fa-48ae-b132-a448c90e26d1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:24.851880 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755fea8-05fa-48ae-b132-a448c90e26d1 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:24.868262 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 154/305] 10.222.0.70 () {60 vars in 1134 bytes} [Wed Aug 24 00:15:24 2022] POST /identity/v3/groups => generated 229 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:24.869074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755fea8-05fa-48ae-b132-a448c90e26d1 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:24.883292 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18006d-108c-4c28-835d-dc1eeffbe97d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:24.899141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:24.927270 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6177-04f2-4220-b9e9-788359d6523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:24.928091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6177-04f2-4220-b9e9-788359d6523b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.928369 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6177-04f2-4220-b9e9-788359d6523b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.929013 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6177-04f2-4220-b9e9-788359d6523b None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.929807 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6177-04f2-4220-b9e9-788359d6523b None admin] RBAC: Adding query filter params (name=reader) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:24.930126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6177-04f2-4220-b9e9-788359d6523b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:24.931552 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6177-04f2-4220-b9e9-788359d6523b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:24.942840 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 152/306] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:24.946033 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ac93-9a35-4670-9c28-3a6872588f8f None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:24.946604 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ac93-9a35-4670-9c28-3a6872588f8f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:24.947100 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ac93-9a35-4670-9c28-3a6872588f8f None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:24.949557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 153/307] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:24.950826 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ac93-9a35-4670-9c28-3a6872588f8f None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:24.969987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:24.997358 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755fea8-05fa-48ae-b132-a448c90e26d1 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:25.040079 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03495ba7-3561-4a98-a04a-d972f0ffddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:25.041067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03495ba7-3561-4a98-a04a-d972f0ffddaa None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:25.041521 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03495ba7-3561-4a98-a04a-d972f0ffddaa None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:25.041962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03495ba7-3561-4a98-a04a-d972f0ffddaa None admin] PATH_INFO: `/v3/users/cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:25.043761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03495ba7-3561-4a98-a04a-d972f0ffddaa None admin] RBAC: Authorizing `identity:get_user(user_id=cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:25.046066 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03495ba7-3561-4a98-a04a-d972f0ffddaa None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:25.048176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 155/308] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:24 2022] GET /identity/v3/users/cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:25.049721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481af7-0e9b-412b-8afb-dcb618b00b79 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:25.050000 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481af7-0e9b-412b-8afb-dcb618b00b79 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:25.050275 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481af7-0e9b-412b-8afb-dcb618b00b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:25.072465 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ac93-9a35-4670-9c28-3a6872588f8f None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:25.073083 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-c4481af7-0e9b-412b-8afb-dcb618b00b79 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:25.074277 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-c4481af7-0e9b-412b-8afb-dcb618b00b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:25.111232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc664039-3b70-4628-8eb0-f5483097f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:25.112018 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664039-3b70-4628-8eb0-f5483097f817 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:25.112288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664039-3b70-4628-8eb0-f5483097f817 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:25.112792 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664039-3b70-4628-8eb0-f5483097f817 None admin] PATH_INFO: `/v3/users/31a2a85d82fc4114ae673ddfcdd32721` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:25.126835 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc664039-3b70-4628-8eb0-f5483097f817 None admin] RBAC: Authorizing `identity:get_user(user_id=31a2a85d82fc4114ae673ddfcdd32721)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:25.128478 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc664039-3b70-4628-8eb0-f5483097f817 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:25.130149 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 154/309] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:24 2022] GET /identity/v3/users/31a2a85d82fc4114ae673ddfcdd32721 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:25.130878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc664039-3b70-4628-8eb0-f5483097f817 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:25.152326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 156/310] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:25.153162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4481af7-0e9b-412b-8afb-dcb618b00b79 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:25.180248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:25.260304 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:25.266830 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc664039-3b70-4628-8eb0-f5483097f817 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:25.266982 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4481af7-0e9b-412b-8afb-dcb618b00b79 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:25.303356 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525eb20-14e5-4d70-baa4-a993408d9301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:25.304079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525eb20-14e5-4d70-baa4-a993408d9301 None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:25.304352 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525eb20-14e5-4d70-baa4-a993408d9301 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:25.304670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525eb20-14e5-4d70-baa4-a993408d9301 None admin] PATH_INFO: `/v3/system/users/cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:25.305881 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:25.306110 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525eb20-14e5-4d70-baa4-a993408d9301 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:25.306662 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:25.307087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:25.307450 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:25.307567 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525eb20-14e5-4d70-baa4-a993408d9301 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:25.308382 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] RBAC: Adding query filter params (role.id=f095e6999c454c259b2221c8b26d7ae7, user.id=31a2a85d82fc4114ae673ddfcdd32721, scope.system=all) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:25.308780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:25.310355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:25.317784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 157/311] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 24 00:15:25 2022] GET /identity/v3/role_assignments?user.id=31a2a85d82fc4114ae673ddfcdd32721&scope.system=all&role.id=f095e6999c454c259b2221c8b26d7ae7 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:25.318979 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 155/312] 10.222.0.70 () {58 vars in 1334 bytes} [Wed Aug 24 00:15:25 2022] PUT /identity/v3/system/users/cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:25.513561 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:25.624275 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45b049-435d-4c76-9b88-1c15a61c26e2 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:25.664648 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac6b1-e48d-454b-8fec-8929387d470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:25.665646 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac6b1-e48d-454b-8fec-8929387d470a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:25.666126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac6b1-e48d-454b-8fec-8929387d470a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:25.666600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac6b1-e48d-454b-8fec-8929387d470a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:25.677956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaac6b1-e48d-454b-8fec-8929387d470a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-0aaac6b1-e48d-454b-8fec-8929387d470a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:25.683092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:25.683987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:25.684786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:25.687343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 158/313] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:25.693180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525eb20-14e5-4d70-baa4-a993408d9301 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:25.795515 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:25.802976 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525eb20-14e5-4d70-baa4-a993408d9301 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:25.849946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:25.850548 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:25.850824 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:25.851091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:25.851749 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:25.852075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:25.853456 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:25.862534 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 156/314] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:25.868136 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac6b1-e48d-454b-8fec-8929387d470a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:25.878397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:25.978384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac6b1-e48d-454b-8fec-8929387d470a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:26.015231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351c14-1a6c-48b8-a631-f93321581523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:26.016157 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351c14-1a6c-48b8-a631-f93321581523 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:26.016579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351c14-1a6c-48b8-a631-f93321581523 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:26.016994 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351c14-1a6c-48b8-a631-f93321581523 None admin] PATH_INFO: `/v3/users/6c3ff3fa1f934e54971df10886a104d3` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:26.018970 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec351c14-1a6c-48b8-a631-f93321581523 None admin] RBAC: Authorizing `identity:get_user(user_id=6c3ff3fa1f934e54971df10886a104d3)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:26.020620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec351c14-1a6c-48b8-a631-f93321581523 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:26.022706 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 159/315] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:25 2022] GET /identity/v3/users/6c3ff3fa1f934e54971df10886a104d3 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:26.028063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:26.137876 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad223116-bb29-427b-b8c8-717029300490 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:26.172395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d2f9-2517-42f8-baab-e5f531b8bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:26.172991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d2f9-2517-42f8-baab-e5f531b8bb8e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:26.173265 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d2f9-2517-42f8-baab-e5f531b8bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:26.173531 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d2f9-2517-42f8-baab-e5f531b8bb8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:26.206043 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:26.247848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d2f9-2517-42f8-baab-e5f531b8bb8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:26.249311 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d2f9-2517-42f8-baab-e5f531b8bb8e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:26.353351 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 157/316] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:26.359010 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351c14-1a6c-48b8-a631-f93321581523 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:26.438914 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:26.482373 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351c14-1a6c-48b8-a631-f93321581523 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:26.525214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f60220-131a-43fb-9d12-66c809c5db38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:26.525925 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f60220-131a-43fb-9d12-66c809c5db38 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:26.526212 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f60220-131a-43fb-9d12-66c809c5db38 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:26.526486 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f60220-131a-43fb-9d12-66c809c5db38 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:26.527744 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f60220-131a-43fb-9d12-66c809c5db38 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:26.529351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f60220-131a-43fb-9d12-66c809c5db38 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:26.532396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 160/317] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:26 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:26.539178 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d2f9-2517-42f8-baab-e5f531b8bb8e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:26.613038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:26.657563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d2f9-2517-42f8-baab-e5f531b8bb8e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:26.694540 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114934-3bd6-4b13-a920-1cf73bd01c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:26.695068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114934-3bd6-4b13-a920-1cf73bd01c32 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:26.695349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114934-3bd6-4b13-a920-1cf73bd01c32 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:26.695624 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114934-3bd6-4b13-a920-1cf73bd01c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:26.696387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3114934-3bd6-4b13-a920-1cf73bd01c32 None admin] RBAC: Adding query filter params (role.id=f095e6999c454c259b2221c8b26d7ae7, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb, user.id=6c3ff3fa1f934e54971df10886a104d3) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:26.696695 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3114934-3bd6-4b13-a920-1cf73bd01c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:26.698120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3114934-3bd6-4b13-a920-1cf73bd01c32 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:26.704554 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 158/318] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:26 2022] GET /identity/v3/role_assignments?user.id=6c3ff3fa1f934e54971df10886a104d3&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=f095e6999c454c259b2221c8b26d7ae7 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:27.192423 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f4811-140a-4cb0-8d49-4999f980c92f None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:27.193436 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f4811-140a-4cb0-8d49-4999f980c92f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:27.193939 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f4811-140a-4cb0-8d49-4999f980c92f None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:27.195750 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 161/319] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:27.201020 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eedac7-155e-4fd9-b80e-3bbcf1a86b48 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:27.201426 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eedac7-155e-4fd9-b80e-3bbcf1a86b48 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:27.201589 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eedac7-155e-4fd9-b80e-3bbcf1a86b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:27.221417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-c6eedac7-155e-4fd9-b80e-3bbcf1a86b48 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:27.222696 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-c6eedac7-155e-4fd9-b80e-3bbcf1a86b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:27.293774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 159/320] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:27.630989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f4811-140a-4cb0-8d49-4999f980c92f None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:27.674372 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855da0-7bf2-462f-9bd5-53b37e9bff79 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:27.674659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855da0-7bf2-462f-9bd5-53b37e9bff79 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:27.674935 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855da0-7bf2-462f-9bd5-53b37e9bff79 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:27.676825 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 160/321] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:27.677893 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9077-2593-4f19-83c3-a6831e40ff17 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:27.678299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9077-2593-4f19-83c3-a6831e40ff17 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:27.679241 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9077-2593-4f19-83c3-a6831e40ff17 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:27.680400 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 161/322] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:27.682223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf009a-3119-4f02-8558-12d9a26ba2f5 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:27.682501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf009a-3119-4f02-8558-12d9a26ba2f5 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:27.682767 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf009a-3119-4f02-8558-12d9a26ba2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:27.701249 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-6abf009a-3119-4f02-8558-12d9a26ba2f5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:27.702433 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-6abf009a-3119-4f02-8558-12d9a26ba2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:27.742422 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f4811-140a-4cb0-8d49-4999f980c92f None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:27.749338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:27.771186 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 162/323] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:27.772429 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b2b75-49d3-490d-9339-218cebe3635b None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:27.772722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b2b75-49d3-490d-9339-218cebe3635b None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:27.773000 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b2b75-49d3-490d-9339-218cebe3635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:27.778683 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196ad4-6373-46c6-a2df-eb952692aa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:27.779803 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196ad4-6373-46c6-a2df-eb952692aa42 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:27.780306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196ad4-6373-46c6-a2df-eb952692aa42 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:27.780765 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196ad4-6373-46c6-a2df-eb952692aa42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:27.781938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1196ad4-6373-46c6-a2df-eb952692aa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:27.783468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1196ad4-6373-46c6-a2df-eb952692aa42 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:27.785325 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 162/324] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:27.790584 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196ad4-6373-46c6-a2df-eb952692aa42 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:27.793666 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-ee4b2b75-49d3-490d-9339-218cebe3635b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:27.794836 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-ee4b2b75-49d3-490d-9339-218cebe3635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:27.802005 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:27.881381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 163/325] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:27.906009 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196ad4-6373-46c6-a2df-eb952692aa42 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:27.943024 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a047-3fe2-4d25-a499-452c423a47ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:27.943632 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a047-3fe2-4d25-a499-452c423a47ed None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:27.943943 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a047-3fe2-4d25-a499-452c423a47ed None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:27.944221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a047-3fe2-4d25-a499-452c423a47ed None admin] PATH_INFO: `/v3/groups` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:27.944836 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954a047-3fe2-4d25-a499-452c423a47ed None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:27.946269 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954a047-3fe2-4d25-a499-452c423a47ed None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:27.967871 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 163/326] 10.222.0.70 () {60 vars in 1134 bytes} [Wed Aug 24 00:15:27 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:15:28.117322 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b2b75-49d3-490d-9339-218cebe3635b None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:28.222840 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a047-3fe2-4d25-a499-452c423a47ed None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:28.224074 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b2b75-49d3-490d-9339-218cebe3635b None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:28.235562 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:28.266664 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac281263-d81b-4b3c-96a5-4105fa8751ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:28.267000 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281263-d81b-4b3c-96a5-4105fa8751ef None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:28.267285 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281263-d81b-4b3c-96a5-4105fa8751ef None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:28.267654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281263-d81b-4b3c-96a5-4105fa8751ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:28.280191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac281263-d81b-4b3c-96a5-4105fa8751ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-ac281263-d81b-4b3c-96a5-4105fa8751ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:28.285141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:28.286048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:28.286857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 164/327] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:28.292130 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac281263-d81b-4b3c-96a5-4105fa8751ef None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:28.309855 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:28.360643 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a047-3fe2-4d25-a499-452c423a47ed None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:28.403727 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc755c-d4c6-4663-88d0-e5803628746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:28.404339 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc755c-d4c6-4663-88d0-e5803628746c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:28.404625 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc755c-d4c6-4663-88d0-e5803628746c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:28.404897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc755c-d4c6-4663-88d0-e5803628746c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:28.416316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac281263-d81b-4b3c-96a5-4105fa8751ef None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:28.416723 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc755c-d4c6-4663-88d0-e5803628746c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-75cc755c-d4c6-4663-88d0-e5803628746c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:28.423112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:28.424659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:28.425433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 164/328] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:28.431563 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc755c-d4c6-4663-88d0-e5803628746c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:28.474499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:28.474499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:28.474499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:28.474499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:28.479091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] RBAC: Adding query filter params (name=member) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:28.479398 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:28.481018 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:28.493538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 165/329] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:28.499127 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:28.546415 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:28.573127 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc755c-d4c6-4663-88d0-e5803628746c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:28.610876 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:28.628044 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:28.628660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:28.628939 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:28.629210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:28.630158 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:28.630257 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:28.631564 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:28.641210 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bf9c2-3c27-41f6-bce3-bc4376c59c47 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:28.644180 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 165/330] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:28.649244 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:28.686463 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76c485-1be1-4168-9e8a-6a827daff4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:28.687560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76c485-1be1-4168-9e8a-6a827daff4c5 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:28.688016 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76c485-1be1-4168-9e8a-6a827daff4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:28.688443 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76c485-1be1-4168-9e8a-6a827daff4c5 None admin] PATH_INFO: `/v3/users/cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:28.690004 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76c485-1be1-4168-9e8a-6a827daff4c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:28.692577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76c485-1be1-4168-9e8a-6a827daff4c5 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:28.694754 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 166/331] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:28 2022] GET /identity/v3/users/cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:28.700600 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76c485-1be1-4168-9e8a-6a827daff4c5 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:28.787810 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b196da-d19f-4138-94d1-46c6eedae933 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:28.835517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d098691-c511-4c06-8762-375bdac2bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:28.835847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:28.836602 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d098691-c511-4c06-8762-375bdac2bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:28.837146 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d098691-c511-4c06-8762-375bdac2bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:28.837382 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d098691-c511-4c06-8762-375bdac2bfc1 None admin] PATH_INFO: `/v3/users/31a2a85d82fc4114ae673ddfcdd32721` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:28.839416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d098691-c511-4c06-8762-375bdac2bfc1 None admin] RBAC: Authorizing `identity:get_user(user_id=31a2a85d82fc4114ae673ddfcdd32721)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:28.840818 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76c485-1be1-4168-9e8a-6a827daff4c5 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:28.841562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d098691-c511-4c06-8762-375bdac2bfc1 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:28.843866 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 166/332] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:28 2022] GET /identity/v3/users/31a2a85d82fc4114ae673ddfcdd32721 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:28.849908 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d098691-c511-4c06-8762-375bdac2bfc1 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:28.885671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e28bd-f51a-4c09-b7c6-b28d5672a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:28.886652 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e28bd-f51a-4c09-b7c6-b28d5672a356 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:28.887072 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e28bd-f51a-4c09-b7c6-b28d5672a356 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:28.887633 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e28bd-f51a-4c09-b7c6-b28d5672a356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:28.888779 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e28bd-f51a-4c09-b7c6-b28d5672a356 None admin] RBAC: Adding query filter params (role.id=811019b55bad4d3982f2f845fd434eb4, user.id=cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4, scope.system=all) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:28.889326 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e28bd-f51a-4c09-b7c6-b28d5672a356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:28.891123 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e28bd-f51a-4c09-b7c6-b28d5672a356 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:28.906223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 167/333] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 24 00:15:28 2022] GET /identity/v3/role_assignments?user.id=cf7427c0fc1e4bc8b1dbbe1c7cd5b7b4&scope.system=all&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:28.931869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:28.982280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d098691-c511-4c06-8762-375bdac2bfc1 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:29.023659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068a613-b982-4002-bb25-60c578708aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:29.024358 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a613-b982-4002-bb25-60c578708aef None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:29.024686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a613-b982-4002-bb25-60c578708aef None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:29.024957 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a613-b982-4002-bb25-60c578708aef None admin] PATH_INFO: `/v3/system/users/31a2a85d82fc4114ae673ddfcdd32721/roles/f095e6999c454c259b2221c8b26d7ae7` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:29.026443 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068a613-b982-4002-bb25-60c578708aef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=31a2a85d82fc4114ae673ddfcdd32721, role_id=f095e6999c454c259b2221c8b26d7ae7)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:29.027860 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068a613-b982-4002-bb25-60c578708aef None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:29.044730 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 167/334] 10.222.0.70 () {58 vars in 1334 bytes} [Wed Aug 24 00:15:28 2022] PUT /identity/v3/system/users/31a2a85d82fc4114ae673ddfcdd32721/roles/f095e6999c454c259b2221c8b26d7ae7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:30.549974 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26df5a-0e31-417b-8597-05e920055ed6 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:30.550503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26df5a-0e31-417b-8597-05e920055ed6 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:30.550503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26df5a-0e31-417b-8597-05e920055ed6 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:30.551854 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 168/335] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:30.558125 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7af9c-04d3-41f5-8e6e-50bf0030fe93 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:30.558591 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7af9c-04d3-41f5-8e6e-50bf0030fe93 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:30.558675 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7af9c-04d3-41f5-8e6e-50bf0030fe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:30.583645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-a4c7af9c-04d3-41f5-8e6e-50bf0030fe93 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:30.584935 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-a4c7af9c-04d3-41f5-8e6e-50bf0030fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:30.675148 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 168/336] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:30.957837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539bd6-b28c-42d9-bd71-05f545673373 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:30.958361 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539bd6-b28c-42d9-bd71-05f545673373 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:30.958784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539bd6-b28c-42d9-bd71-05f545673373 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:30.960607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 169/337] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:30.966039 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d23d-0d6e-41a7-b508-c177375d5918 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:30.966615 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d23d-0d6e-41a7-b508-c177375d5918 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:30.967090 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d23d-0d6e-41a7-b508-c177375d5918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:30.992369 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-5ca3d23d-0d6e-41a7-b508-c177375d5918 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:30.993904 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-5ca3d23d-0d6e-41a7-b508-c177375d5918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:31.055788 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:31.079141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 169/338] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:31.267148 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79539bd6-b28c-42d9-bd71-05f545673373 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:31.385568 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79539bd6-b28c-42d9-bd71-05f545673373 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:31.429416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c6f14-50a7-4479-a9b8-afdcd87ee0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:31.430411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6f14-50a7-4479-a9b8-afdcd87ee0e3 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:31.430925 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6f14-50a7-4479-a9b8-afdcd87ee0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:31.431400 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6f14-50a7-4479-a9b8-afdcd87ee0e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:31.445689 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c6f14-50a7-4479-a9b8-afdcd87ee0e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-dc7c6f14-50a7-4479-a9b8-afdcd87ee0e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:31.451357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:31.452248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:31.453027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:31.455767 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 170/339] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:31.461701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3d23d-0d6e-41a7-b508-c177375d5918 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:31.594909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3d23d-0d6e-41a7-b508-c177375d5918 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:31.646084 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:31.647135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:31.647630 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:31.648139 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:31.649041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:31.649561 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:31.651170 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:31.667861 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c6f14-50a7-4479-a9b8-afdcd87ee0e3 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:31.669484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 170/340] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:31.713106 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:31.737619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:31.802729 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:31.874475 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c6f14-50a7-4479-a9b8-afdcd87ee0e3 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:31.912500 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5400ff5-e111-4bc5-8c46-9a693a5f903b None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:31.964013 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19640aa8-1862-488d-a9c4-7462f73be25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:31.965150 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640aa8-1862-488d-a9c4-7462f73be25a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:31.965690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640aa8-1862-488d-a9c4-7462f73be25a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:31.966172 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640aa8-1862-488d-a9c4-7462f73be25a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:31.966997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32561e-33d4-47ca-9702-082c8036d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:31.967587 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32561e-33d4-47ca-9702-082c8036d0eb None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:31.967881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32561e-33d4-47ca-9702-082c8036d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:31.968154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32561e-33d4-47ca-9702-082c8036d0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:31.991941 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19640aa8-1862-488d-a9c4-7462f73be25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-19640aa8-1862-488d-a9c4-7462f73be25a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:31.999570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:32.000533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:32.001310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:32.005034 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 171/341] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:32.005034 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68b32-aa97-4f3b-8b48-4666cc1a17c1 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:32.005252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68b32-aa97-4f3b-8b48-4666cc1a17c1 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:32.006426 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68b32-aa97-4f3b-8b48-4666cc1a17c1 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:32.007737 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 172/342] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:32.011414 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea68b32-aa97-4f3b-8b48-4666cc1a17c1 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:32.120684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32561e-33d4-47ca-9702-082c8036d0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:32.122170 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32561e-33d4-47ca-9702-082c8036d0eb None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:32.132033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea68b32-aa97-4f3b-8b48-4666cc1a17c1 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:32.140255 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:32.174285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b809d7-2cbd-4d70-b772-dff46dd8da0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:32.174975 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b809d7-2cbd-4d70-b772-dff46dd8da0c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:32.175260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b809d7-2cbd-4d70-b772-dff46dd8da0c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:32.175535 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b809d7-2cbd-4d70-b772-dff46dd8da0c None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:32.176406 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b809d7-2cbd-4d70-b772-dff46dd8da0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:32.176723 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b809d7-2cbd-4d70-b772-dff46dd8da0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:32.178178 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b809d7-2cbd-4d70-b772-dff46dd8da0c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:32.184113 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:32.188711 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 173/343] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:32.190509 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f01c0-93f0-4efc-9ee3-a2d305c819c7 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:32.191015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f01c0-93f0-4efc-9ee3-a2d305c819c7 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:32.192137 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f01c0-93f0-4efc-9ee3-a2d305c819c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:32.213001 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-399f01c0-93f0-4efc-9ee3-a2d305c819c7 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:32.214367 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-399f01c0-93f0-4efc-9ee3-a2d305c819c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:32.292558 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 174/344] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:32.293341 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f01c0-93f0-4efc-9ee3-a2d305c819c7 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:32.369559 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 171/345] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:32.393938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32561e-33d4-47ca-9702-082c8036d0eb None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:32.412958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f01c0-93f0-4efc-9ee3-a2d305c819c7 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:32.416276 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:32.517058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe0202-1ebc-4a90-87ca-3b78dc53c1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:32.518835 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0202-1ebc-4a90-87ca-3b78dc53c1e4 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:32.519319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0202-1ebc-4a90-87ca-3b78dc53c1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:32.519952 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0202-1ebc-4a90-87ca-3b78dc53c1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:32.607756 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32561e-33d4-47ca-9702-082c8036d0eb None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:32.646286 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:32.673014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556c424-ea7f-4c61-a340-210753889462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:32.675054 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556c424-ea7f-4c61-a340-210753889462 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:32.675523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556c424-ea7f-4c61-a340-210753889462 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:32.680359 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556c424-ea7f-4c61-a340-210753889462 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:32.682272 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556c424-ea7f-4c61-a340-210753889462 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:32.684499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556c424-ea7f-4c61-a340-210753889462 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:32.688079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 172/346] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:32 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:32.693732 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556c424-ea7f-4c61-a340-210753889462 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:32.695169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe0202-1ebc-4a90-87ca-3b78dc53c1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:32.697218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe0202-1ebc-4a90-87ca-3b78dc53c1e4 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:32.849152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556c424-ea7f-4c61-a340-210753889462 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:32.868261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:32.877370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 175/347] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:32.879987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae703-a688-4c7f-ab82-6e026ab0ab72 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:32.880358 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae703-a688-4c7f-ab82-6e026ab0ab72 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:32.880635 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae703-a688-4c7f-ab82-6e026ab0ab72 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:32.883789 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 176/348] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:32.884944 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fae703-a688-4c7f-ab82-6e026ab0ab72 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:32.904646 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52123b-d2d4-4d69-9fff-99a576c584bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:32.905536 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52123b-d2d4-4d69-9fff-99a576c584bc None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:32.905970 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52123b-d2d4-4d69-9fff-99a576c584bc None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:32.906397 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52123b-d2d4-4d69-9fff-99a576c584bc None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:32.913797 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52123b-d2d4-4d69-9fff-99a576c584bc None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:32.915561 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52123b-d2d4-4d69-9fff-99a576c584bc None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:32.917703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 173/349] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:32 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:32.918639 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52123b-d2d4-4d69-9fff-99a576c584bc None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:32.975423 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:33.014549 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fae703-a688-4c7f-ab82-6e026ab0ab72 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:33.044163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52123b-d2d4-4d69-9fff-99a576c584bc None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:33.063954 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351b950-2e1d-4f46-8daa-57386223448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:33.065164 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b950-2e1d-4f46-8daa-57386223448d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.065449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b950-2e1d-4f46-8daa-57386223448d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.065847 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b950-2e1d-4f46-8daa-57386223448d None admin] PATH_INFO: `/v3/roles/member` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.077577 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351b950-2e1d-4f46-8daa-57386223448d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-8351b950-2e1d-4f46-8daa-57386223448d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:33.083715 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:33.084660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:33.085448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:33.086077 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 177/350] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:33.086801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03be422-fcb8-44df-a8c2-69e642153a91 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.086986 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd29d-96ea-4851-8ca8-524d2f1ae292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:33.087161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03be422-fcb8-44df-a8c2-69e642153a91 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.087582 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03be422-fcb8-44df-a8c2-69e642153a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.087691 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd29d-96ea-4851-8ca8-524d2f1ae292 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.088017 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd29d-96ea-4851-8ca8-524d2f1ae292 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.088296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd29d-96ea-4851-8ca8-524d2f1ae292 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.089616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dd29d-96ea-4851-8ca8-524d2f1ae292 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:33.091041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dd29d-96ea-4851-8ca8-524d2f1ae292 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:33.092738 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 174/351] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:32 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:33.093618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd29d-96ea-4851-8ca8-524d2f1ae292 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:33.112871 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b03be422-fcb8-44df-a8c2-69e642153a91 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:33.114409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b03be422-fcb8-44df-a8c2-69e642153a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:33.175936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:33.203402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 178/352] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:33.203402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572231f-35ee-422f-bc14-a8919fcc6125 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.203402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572231f-35ee-422f-bc14-a8919fcc6125 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.203402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572231f-35ee-422f-bc14-a8919fcc6125 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.204701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 179/353] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:33.205934 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572231f-35ee-422f-bc14-a8919fcc6125 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:33.221373 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd29d-96ea-4851-8ca8-524d2f1ae292 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:33.245366 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:33.271420 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:33.272142 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.272421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.272706 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.273622 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] RBAC: Adding query filter params (group.id=dc394c7b1855430d98d20216daa7d98e, role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=303d80342777404a8a19015531902390) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:33.274409 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:33.275405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:33.282557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 175/354] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:33 2022] GET /identity/v3/role_assignments?group.id=dc394c7b1855430d98d20216daa7d98e&scope.project.id=303d80342777404a8a19015531902390&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:33.284152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:33.383020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572231f-35ee-422f-bc14-a8919fcc6125 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:33.457683 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5188023-ab6b-404a-b1d0-818286e33342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:33.458434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5188023-ab6b-404a-b1d0-818286e33342 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.458718 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5188023-ab6b-404a-b1d0-818286e33342 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.458991 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5188023-ab6b-404a-b1d0-818286e33342 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.459667 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5188023-ab6b-404a-b1d0-818286e33342 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:33.459994 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5188023-ab6b-404a-b1d0-818286e33342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:33.463818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5188023-ab6b-404a-b1d0-818286e33342 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:33.490144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 180/355] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:33.490144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0f50d-2a9e-4205-8b2c-76fd31e60cfc None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.490144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0f50d-2a9e-4205-8b2c-76fd31e60cfc None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.490144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0f50d-2a9e-4205-8b2c-76fd31e60cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.492939 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07be68a-a47b-4fd7-b88b-dc281d529378 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:33.512619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-5aa0f50d-2a9e-4205-8b2c-76fd31e60cfc None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:33.513846 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-5aa0f50d-2a9e-4205-8b2c-76fd31e60cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:33.540758 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff795f-5318-484c-853a-a427605819f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:33.541729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff795f-5318-484c-853a-a427605819f2 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.542220 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff795f-5318-484c-853a-a427605819f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.542712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff795f-5318-484c-853a-a427605819f2 None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.544382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff795f-5318-484c-853a-a427605819f2 None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:33.546411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff795f-5318-484c-853a-a427605819f2 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:33.548584 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 176/356] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:33 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:33.549923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff795f-5318-484c-853a-a427605819f2 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:33.567618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:33.593469 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 181/357] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:33.594543 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decaf2c-fe20-478a-b103-9e6684ce24fb None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.594823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decaf2c-fe20-478a-b103-9e6684ce24fb None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.595087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decaf2c-fe20-478a-b103-9e6684ce24fb None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.605287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 182/358] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:33.606197 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decaf2c-fe20-478a-b103-9e6684ce24fb None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:33.611624 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:33.668612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff795f-5318-484c-853a-a427605819f2 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:33.708747 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff3b17-ace8-4bf6-b0bf-eec2e54f2ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:33.710202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3b17-ace8-4bf6-b0bf-eec2e54f2ce4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.710690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3b17-ace8-4bf6-b0bf-eec2e54f2ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.711179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3b17-ace8-4bf6-b0bf-eec2e54f2ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.738791 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decaf2c-fe20-478a-b103-9e6684ce24fb None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:33.790861 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e6c08-3951-4c92-b88f-8afad6da75f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:33.791193 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6c08-3951-4c92-b88f-8afad6da75f1 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.791470 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6c08-3951-4c92-b88f-8afad6da75f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.791818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6c08-3951-4c92-b88f-8afad6da75f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.792538 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e6c08-3951-4c92-b88f-8afad6da75f1 None admin] RBAC: Adding query filter params (group.id=dc394c7b1855430d98d20216daa7d98e, role.id=bc92a32951104b92b187e6cb51ef9bd8, scope.project.id=303d80342777404a8a19015531902390) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:33.792842 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e6c08-3951-4c92-b88f-8afad6da75f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:33.794328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e6c08-3951-4c92-b88f-8afad6da75f1 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:33.799409 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff3b17-ace8-4bf6-b0bf-eec2e54f2ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:33.801388 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff3b17-ace8-4bf6-b0bf-eec2e54f2ce4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:33.804241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 183/359] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:33 2022] GET /identity/v3/role_assignments?group.id=dc394c7b1855430d98d20216daa7d98e&scope.project.id=303d80342777404a8a19015531902390&role.id=bc92a32951104b92b187e6cb51ef9bd8 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:33.805459 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6212-09b9-4db9-a76c-e9fc32a96d9e None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:33.805733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6212-09b9-4db9-a76c-e9fc32a96d9e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:33.805999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6212-09b9-4db9-a76c-e9fc32a96d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:33.844743 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b29c6212-09b9-4db9-a76c-e9fc32a96d9e None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:33.847605 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b29c6212-09b9-4db9-a76c-e9fc32a96d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:33.910197 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:33.921125 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:34.002311 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 184/360] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:34.003161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c6212-09b9-4db9-a76c-e9fc32a96d9e None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.031753 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 177/361] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:34.038770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff3b17-ace8-4bf6-b0bf-eec2e54f2ce4 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.151371 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff3b17-ace8-4bf6-b0bf-eec2e54f2ce4 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:34.206951 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f13e-ef9c-4c72-b178-94bbaeef4f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:34.207781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f13e-ef9c-4c72-b178-94bbaeef4f5a None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:34.209383 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f13e-ef9c-4c72-b178-94bbaeef4f5a None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:34.209667 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f13e-ef9c-4c72-b178-94bbaeef4f5a None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:34.211636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766f13e-ef9c-4c72-b178-94bbaeef4f5a None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:34.213198 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766f13e-ef9c-4c72-b178-94bbaeef4f5a None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:34.219344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 178/362] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:34.220164 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f13e-ef9c-4c72-b178-94bbaeef4f5a None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.240971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c6212-09b9-4db9-a76c-e9fc32a96d9e None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:34.258307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:34.312285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5f6a8-36bf-4fad-96aa-427bbbdd05fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:34.312926 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5f6a8-36bf-4fad-96aa-427bbbdd05fd None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:34.313205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5f6a8-36bf-4fad-96aa-427bbbdd05fd None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:34.313493 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5f6a8-36bf-4fad-96aa-427bbbdd05fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:34.333349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5f6a8-36bf-4fad-96aa-427bbbdd05fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-46a5f6a8-36bf-4fad-96aa-427bbbdd05fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:34.338128 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:34.339048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:15:34.339806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:34.343697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 185/363] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:34.346787 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5f6a8-36bf-4fad-96aa-427bbbdd05fd None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.398292 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:34.436331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f13e-ef9c-4c72-b178-94bbaeef4f5a None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:34.495769 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbd104-acd5-4e1b-a631-4ae62ea240b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:34.496429 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbd104-acd5-4e1b-a631-4ae62ea240b1 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:34.496877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbd104-acd5-4e1b-a631-4ae62ea240b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:34.497160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbd104-acd5-4e1b-a631-4ae62ea240b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:34.510867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5f6a8-36bf-4fad-96aa-427bbbdd05fd None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:34.514444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbd104-acd5-4e1b-a631-4ae62ea240b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-6abbd104-acd5-4e1b-a631-4ae62ea240b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:34.522712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:34.523634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:34.524439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 179/364] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:34.525583 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbd104-acd5-4e1b-a631-4ae62ea240b1 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.557389 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d08ea-288c-4335-b623-776ebd513b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:34.558009 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d08ea-288c-4335-b623-776ebd513b1f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:34.558280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d08ea-288c-4335-b623-776ebd513b1f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:34.558543 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d08ea-288c-4335-b623-776ebd513b1f None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:34.559656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d08ea-288c-4335-b623-776ebd513b1f None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:34.561135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d08ea-288c-4335-b623-776ebd513b1f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:34.563017 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 186/365] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:34.563791 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d08ea-288c-4335-b623-776ebd513b1f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.640791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:34.686028 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbd104-acd5-4e1b-a631-4ae62ea240b1 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:34.714917 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:34.722682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d08ea-288c-4335-b623-776ebd513b1f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:34.740245 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:34.741563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:34.741974 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:34.742315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:34.743169 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] RBAC: Adding query filter params (name=reader) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:34.743533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:34.745099 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:34.761146 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 180/366] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:34.761146 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.774900 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3935eb0-fa7f-4c29-8703-01c443b7d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:34.776997 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3935eb0-fa7f-4c29-8703-01c443b7d032 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:34.777891 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3935eb0-fa7f-4c29-8703-01c443b7d032 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:34.778414 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3935eb0-fa7f-4c29-8703-01c443b7d032 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:34.793449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3935eb0-fa7f-4c29-8703-01c443b7d032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-c3935eb0-fa7f-4c29-8703-01c443b7d032 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:34.801907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:34.802816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:34.803580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:34.808166 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 187/367] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:34.808166 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3935eb0-fa7f-4c29-8703-01c443b7d032 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.901067 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f66de5-b51b-4e14-bdea-aae5af1648af None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:34.941536 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:34.942104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:34.942380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:34.942652 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:34.943311 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:34.943609 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:34.945015 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:34.954215 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 181/368] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:34.955648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:34.957154 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3935eb0-fa7f-4c29-8703-01c443b7d032 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:34.958410 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:35.012042 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:35.013045 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:35.013539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:35.014082 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:35.015003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] RBAC: Adding query filter params (group.id=dc394c7b1855430d98d20216daa7d98e, role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:35.015505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:35.017232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:35.024993 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 188/369] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/role_assignments?group.id=dc394c7b1855430d98d20216daa7d98e&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:35.026549 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:35.057091 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:35.106665 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4433a-09e2-4c5e-bdf1-37a0335a4bb6 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:35.157672 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ca8f-b980-4097-aef0-47775c631412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:35.159958 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ca8f-b980-4097-aef0-47775c631412 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:35.160444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ca8f-b980-4097-aef0-47775c631412 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:35.160887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ca8f-b980-4097-aef0-47775c631412 None admin] PATH_INFO: `/v3/users/31a2a85d82fc4114ae673ddfcdd32721` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:35.162157 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eaf49-1917-4e27-9f9f-bb9d6cbea3b2 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:35.162424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820ca8f-b980-4097-aef0-47775c631412 None admin] RBAC: Authorizing `identity:get_user(user_id=31a2a85d82fc4114ae673ddfcdd32721)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:35.164237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820ca8f-b980-4097-aef0-47775c631412 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:35.167015 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 182/370] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 00:15:34 2022] GET /identity/v3/users/31a2a85d82fc4114ae673ddfcdd32721 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:35.168079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ca8f-b980-4097-aef0-47775c631412 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:35.229953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:35.230726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:35.231081 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:35.231667 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:35.232662 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:35.233039 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:35.235433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:35.252053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 189/371] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:35.252053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:35.269367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:35.308975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ca8f-b980-4097-aef0-47775c631412 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:35.360716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10219b-f6bd-4f9e-b4be-cea4a105ba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:35.361991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10219b-f6bd-4f9e-b4be-cea4a105ba3b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:35.362330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10219b-f6bd-4f9e-b4be-cea4a105ba3b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:35.363302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10219b-f6bd-4f9e-b4be-cea4a105ba3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:35.372661 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:35.391130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698455d-e39b-4fe7-a635-d3b9f2f97ff4 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:35.432734 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:35.433718 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:35.434299 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:35.434750 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:35.435755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] RBAC: Adding query filter params (role.id=f095e6999c454c259b2221c8b26d7ae7, user.id=31a2a85d82fc4114ae673ddfcdd32721, scope.system=all) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:35.436291 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:35.437935 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:35.452682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 190/372] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 24 00:15:35 2022] GET /identity/v3/role_assignments?user.id=31a2a85d82fc4114ae673ddfcdd32721&scope.system=all&role.id=f095e6999c454c259b2221c8b26d7ae7 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:35.453822 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:35.469850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10219b-f6bd-4f9e-b4be-cea4a105ba3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:35.472379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10219b-f6bd-4f9e-b4be-cea4a105ba3b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:35.609819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:35.662654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 183/373] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:35.674520 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10219b-f6bd-4f9e-b4be-cea4a105ba3b None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:35.727716 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b152834-a226-4fe9-bef1-344ea53f4d6a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:35.787752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a4557-2fb7-4683-8169-1a6a2ec8d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:35.788403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a4557-2fb7-4683-8169-1a6a2ec8d246 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:35.788674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a4557-2fb7-4683-8169-1a6a2ec8d246 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:35.788948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a4557-2fb7-4683-8169-1a6a2ec8d246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:35.810445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:35.865307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10219b-f6bd-4f9e-b4be-cea4a105ba3b None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:35.904036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a4557-2fb7-4683-8169-1a6a2ec8d246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:35.906386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a4557-2fb7-4683-8169-1a6a2ec8d246 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:35.935422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53db2ee-7485-422c-8689-dc81db6a0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:35.936255 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53db2ee-7485-422c-8689-dc81db6a0cbb None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:35.936641 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53db2ee-7485-422c-8689-dc81db6a0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:35.938043 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53db2ee-7485-422c-8689-dc81db6a0cbb None admin] PATH_INFO: `/v3/projects/b165c34800e2494a8f309a6e802bd8dd` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:35.938781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53db2ee-7485-422c-8689-dc81db6a0cbb None admin] RBAC: Authorizing `identity:get_project(project_id=b165c34800e2494a8f309a6e802bd8dd)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:35.942159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53db2ee-7485-422c-8689-dc81db6a0cbb None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:35.945115 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 184/374] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:35 2022] GET /identity/v3/projects/b165c34800e2494a8f309a6e802bd8dd => generated 344 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:35.952166 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53db2ee-7485-422c-8689-dc81db6a0cbb None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:36.011116 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:36.080271 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 191/375] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:36.085450 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a4557-2fb7-4683-8169-1a6a2ec8d246 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:36.107945 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53db2ee-7485-422c-8689-dc81db6a0cbb None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:36.168302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:36.180838 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a329ca0-8964-401c-9871-e7d5c236b59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:36.181478 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329ca0-8964-401c-9871-e7d5c236b59e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:36.181761 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329ca0-8964-401c-9871-e7d5c236b59e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:36.182032 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329ca0-8964-401c-9871-e7d5c236b59e None admin] PATH_INFO: `/v3/groups/18b3375310114650b848aa61d6056c8e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:36.191425 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a329ca0-8964-401c-9871-e7d5c236b59e None admin] RBAC: Authorizing `identity:get_group(group_id=18b3375310114650b848aa61d6056c8e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:36.192908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a329ca0-8964-401c-9871-e7d5c236b59e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:36.202439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 185/376] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:35 2022] GET /identity/v3/groups/18b3375310114650b848aa61d6056c8e => generated 229 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:36.213157 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a329ca0-8964-401c-9871-e7d5c236b59e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:36.269446 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a4557-2fb7-4683-8169-1a6a2ec8d246 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:36.311944 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beb87a-7331-4925-8404-9b2ab2ada220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:36.312584 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb87a-7331-4925-8404-9b2ab2ada220 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:36.312865 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb87a-7331-4925-8404-9b2ab2ada220 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:36.313158 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb87a-7331-4925-8404-9b2ab2ada220 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:36.314420 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beb87a-7331-4925-8404-9b2ab2ada220 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:36.317860 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beb87a-7331-4925-8404-9b2ab2ada220 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:36.317860 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 192/377] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:36 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:36.318835 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b13e39-2cf9-448e-b71d-f0d291a6ad04 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:36.319120 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b13e39-2cf9-448e-b71d-f0d291a6ad04 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:36.321801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b13e39-2cf9-448e-b71d-f0d291a6ad04 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:36.323703 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 193/378] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:36.324624 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b13e39-2cf9-448e-b71d-f0d291a6ad04 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:36.352910 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a329ca0-8964-401c-9871-e7d5c236b59e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:36.368280 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:36.408486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f1c0a-4640-4601-9391-d6e6bc587d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:36.410687 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f1c0a-4640-4601-9391-d6e6bc587d13 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:36.411183 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f1c0a-4640-4601-9391-d6e6bc587d13 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:36.411678 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f1c0a-4640-4601-9391-d6e6bc587d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:36.412627 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f1c0a-4640-4601-9391-d6e6bc587d13 None admin] RBAC: Adding query filter params (group.id=18b3375310114650b848aa61d6056c8e, role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=b165c34800e2494a8f309a6e802bd8dd) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:36.413132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f1c0a-4640-4601-9391-d6e6bc587d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:36.414752 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f1c0a-4640-4601-9391-d6e6bc587d13 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:36.423982 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 186/379] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:36 2022] GET /identity/v3/role_assignments?group.id=18b3375310114650b848aa61d6056c8e&scope.project.id=b165c34800e2494a8f309a6e802bd8dd&role.id=952eea31fada4104858d315ac0f1296a => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:36.425445 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ae28-7d99-417f-af83-c7ed55eabf76 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:36.425920 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ae28-7d99-417f-af83-c7ed55eabf76 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:36.426380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ae28-7d99-417f-af83-c7ed55eabf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:36.448461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-e3e3ae28-7d99-417f-af83-c7ed55eabf76 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:36.450185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-e3e3ae28-7d99-417f-af83-c7ed55eabf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:36.467412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b13e39-2cf9-448e-b71d-f0d291a6ad04 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:36.504694 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:36.547403 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 187/380] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:36.556807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad0b4-e3ca-47ae-afd2-8c23a73d3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:36.557470 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad0b4-e3ca-47ae-afd2-8c23a73d3dce None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:36.557800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad0b4-e3ca-47ae-afd2-8c23a73d3dce None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:36.558080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad0b4-e3ca-47ae-afd2-8c23a73d3dce None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:36.559387 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ad0b4-e3ca-47ae-afd2-8c23a73d3dce None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:36.561073 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ad0b4-e3ca-47ae-afd2-8c23a73d3dce None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:36.563088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 194/381] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:36 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:36.570389 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ae28-7d99-417f-af83-c7ed55eabf76 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:36.684876 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:36.696131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ae28-7d99-417f-af83-c7ed55eabf76 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:36.742389 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdc080-58b4-4f1b-9eec-a8d3afe257d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:36.743340 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdc080-58b4-4f1b-9eec-a8d3afe257d9 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:36.743914 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdc080-58b4-4f1b-9eec-a8d3afe257d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:36.744392 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdc080-58b4-4f1b-9eec-a8d3afe257d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:36.745307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdc080-58b4-4f1b-9eec-a8d3afe257d9 None admin] RBAC: Adding query filter params (group.id=dc394c7b1855430d98d20216daa7d98e, role.id=bc92a32951104b92b187e6cb51ef9bd8, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:36.745804 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdc080-58b4-4f1b-9eec-a8d3afe257d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:36.747426 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdc080-58b4-4f1b-9eec-a8d3afe257d9 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:36.754334 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 188/382] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:36 2022] GET /identity/v3/role_assignments?group.id=dc394c7b1855430d98d20216daa7d98e&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=bc92a32951104b92b187e6cb51ef9bd8 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:36.998205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad0b4-e3ca-47ae-afd2-8c23a73d3dce None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:37.113964 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad0b4-e3ca-47ae-afd2-8c23a73d3dce None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:37.123703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e79c36-906e-4198-9939-df07badfd2ff None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:37.124213 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e79c36-906e-4198-9939-df07badfd2ff None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:37.124317 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e79c36-906e-4198-9939-df07badfd2ff None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:37.126404 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 189/383] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:37.144483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5804c7-def6-4ad2-9651-08159eaf8c0c None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:37.144899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5804c7-def6-4ad2-9651-08159eaf8c0c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:37.145682 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5804c7-def6-4ad2-9651-08159eaf8c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:37.162936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515edd6f-5ee2-437c-8cf6-b4ce3dba89ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:37.163577 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515edd6f-5ee2-437c-8cf6-b4ce3dba89ff None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:37.163883 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515edd6f-5ee2-437c-8cf6-b4ce3dba89ff None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:37.164159 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515edd6f-5ee2-437c-8cf6-b4ce3dba89ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:37.172858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-9e5804c7-def6-4ad2-9651-08159eaf8c0c None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:37.174589 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-9e5804c7-def6-4ad2-9651-08159eaf8c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:37.183881 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515edd6f-5ee2-437c-8cf6-b4ce3dba89ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-515edd6f-5ee2-437c-8cf6-b4ce3dba89ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:37.184328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:37.185184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:37.186378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 195/384] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:37.192685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515edd6f-5ee2-437c-8cf6-b4ce3dba89ff None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:37.271657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:37.288583 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 190/385] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:37.375119 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515edd6f-5ee2-437c-8cf6-b4ce3dba89ff None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:37.421308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:37.421919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:37.422306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:37.422586 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:37.423279 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:37.424291 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:37.425674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:37.440767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 196/386] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:37.446750 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5804c7-def6-4ad2-9651-08159eaf8c0c None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:37.576985 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:37.589500 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5804c7-def6-4ad2-9651-08159eaf8c0c None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:37.639393 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c743c-47db-4c85-968d-fe03e4e5c397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:37.640049 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c743c-47db-4c85-968d-fe03e4e5c397 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:37.640326 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c743c-47db-4c85-968d-fe03e4e5c397 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:37.640596 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c743c-47db-4c85-968d-fe03e4e5c397 None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:37.641709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c743c-47db-4c85-968d-fe03e4e5c397 None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:37.644041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c743c-47db-4c85-968d-fe03e4e5c397 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:37.645915 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 191/387] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:37 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:37.651088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:37.804838 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238704a-dfb0-4396-9a32-1f73ba378224 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:37.806397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:37.852156 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a146c-7875-4d55-8d78-6c099c61a353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:37.852733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a146c-7875-4d55-8d78-6c099c61a353 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:37.853015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a146c-7875-4d55-8d78-6c099c61a353 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:37.853309 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a146c-7875-4d55-8d78-6c099c61a353 None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:37.856838 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a146c-7875-4d55-8d78-6c099c61a353 None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:37.858334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a146c-7875-4d55-8d78-6c099c61a353 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:37.860333 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 197/388] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:37 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:37.866078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c743c-47db-4c85-968d-fe03e4e5c397 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:37.887097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a146c-7875-4d55-8d78-6c099c61a353 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:38.012368 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a146c-7875-4d55-8d78-6c099c61a353 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:38.053120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c743c-47db-4c85-968d-fe03e4e5c397 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:38.053313 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49624-9100-437d-9e7e-ecc711e60dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:38.055241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49624-9100-437d-9e7e-ecc711e60dcc None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:38.055241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49624-9100-437d-9e7e-ecc711e60dcc None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:38.055241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49624-9100-437d-9e7e-ecc711e60dcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:38.084824 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be49624-9100-437d-9e7e-ecc711e60dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-7be49624-9100-437d-9e7e-ecc711e60dcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:38.090130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:38.090998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:38.092241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 198/389] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:38.100023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49624-9100-437d-9e7e-ecc711e60dcc None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:38.111891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437b27-49f3-4bc9-a76f-595efce1bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:38.112406 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437b27-49f3-4bc9-a76f-595efce1bddd None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:38.112679 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437b27-49f3-4bc9-a76f-595efce1bddd None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:38.112944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437b27-49f3-4bc9-a76f-595efce1bddd None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390/groups/dc394c7b1855430d98d20216daa7d98e/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:38.116946 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437b27-49f3-4bc9-a76f-595efce1bddd None admin] RBAC: Authorizing `identity:create_grant(project_id=303d80342777404a8a19015531902390, group_id=dc394c7b1855430d98d20216daa7d98e, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:38.118381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437b27-49f3-4bc9-a76f-595efce1bddd None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:38.146514 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 192/390] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 00:15:37 2022] PUT /identity/v3/projects/303d80342777404a8a19015531902390/groups/dc394c7b1855430d98d20216daa7d98e/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:38.167184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:38.244270 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a77ba4-6378-4a67-9aaa-2dab26dab5d1 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:38.244952 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a77ba4-6378-4a67-9aaa-2dab26dab5d1 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:38.245421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a77ba4-6378-4a67-9aaa-2dab26dab5d1 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:38.247437 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 193/391] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:15:38.254919 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997571f4-2921-471e-a8fd-1bb7c68cc201 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:38.255519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997571f4-2921-471e-a8fd-1bb7c68cc201 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:38.256036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997571f4-2921-471e-a8fd-1bb7c68cc201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:38.283311 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-997571f4-2921-471e-a8fd-1bb7c68cc201 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:38.284653 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-997571f4-2921-471e-a8fd-1bb7c68cc201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:38.292566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49624-9100-437d-9e7e-ecc711e60dcc None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:38.320903 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:38.367489 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:38.368065 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:38.370334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:38.370622 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:38.371304 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:38.371610 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:38.373031 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:38.383016 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 199/392] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:38.389084 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:38.438160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 194/393] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:38.494790 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:38.504786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311dc79-363b-4f26-b700-fdc9014b0bc6 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:38.543648 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80264d-49cb-4144-b634-b6b8542d6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:38.544672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80264d-49cb-4144-b634-b6b8542d6df0 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:38.545516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80264d-49cb-4144-b634-b6b8542d6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:38.545980 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80264d-49cb-4144-b634-b6b8542d6df0 None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:38.547332 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80264d-49cb-4144-b634-b6b8542d6df0 None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:38.549043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80264d-49cb-4144-b634-b6b8542d6df0 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:38.551363 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 200/394] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:38 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:38.556670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997571f4-2921-471e-a8fd-1bb7c68cc201 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:38.664806 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997571f4-2921-471e-a8fd-1bb7c68cc201 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:38.712721 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e5f60-72a7-4055-87bf-1a166efbfcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:38.713689 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e5f60-72a7-4055-87bf-1a166efbfcac None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:38.714195 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e5f60-72a7-4055-87bf-1a166efbfcac None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:38.714672 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e5f60-72a7-4055-87bf-1a166efbfcac None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:38.716839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e5f60-72a7-4055-87bf-1a166efbfcac None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:38.718607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e5f60-72a7-4055-87bf-1a166efbfcac None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:38.721375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 195/395] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:38 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:38.726975 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80264d-49cb-4144-b634-b6b8542d6df0 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:38.850185 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80264d-49cb-4144-b634-b6b8542d6df0 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:38.896286 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641302-c514-4ed6-8c0f-82ece2118bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:38.896960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641302-c514-4ed6-8c0f-82ece2118bbf None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:38.897241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641302-c514-4ed6-8c0f-82ece2118bbf None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:38.897517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641302-c514-4ed6-8c0f-82ece2118bbf None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390/groups/dc394c7b1855430d98d20216daa7d98e/roles/bc92a32951104b92b187e6cb51ef9bd8` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:38.905073 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a641302-c514-4ed6-8c0f-82ece2118bbf None admin] RBAC: Authorizing `identity:create_grant(project_id=303d80342777404a8a19015531902390, group_id=dc394c7b1855430d98d20216daa7d98e, role_id=bc92a32951104b92b187e6cb51ef9bd8)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:38.906523 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a641302-c514-4ed6-8c0f-82ece2118bbf None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:38.931328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 201/396] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 00:15:38 2022] PUT /identity/v3/projects/303d80342777404a8a19015531902390/groups/dc394c7b1855430d98d20216daa7d98e/roles/bc92a32951104b92b187e6cb51ef9bd8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:39.019802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e5f60-72a7-4055-87bf-1a166efbfcac None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:39.045873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:39.153431 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e5f60-72a7-4055-87bf-1a166efbfcac None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:39.196565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd1687-194f-44e9-a27a-5e99626b7db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:39.197114 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd1687-194f-44e9-a27a-5e99626b7db8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:39.197387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd1687-194f-44e9-a27a-5e99626b7db8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:39.197653 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd1687-194f-44e9-a27a-5e99626b7db8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:39.209458 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd1687-194f-44e9-a27a-5e99626b7db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-42bd1687-194f-44e9-a27a-5e99626b7db8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:39.214299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:39.215225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:39.216188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 196/397] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:39.223217 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641302-c514-4ed6-8c0f-82ece2118bbf None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:39.250702 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:39.346603 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641302-c514-4ed6-8c0f-82ece2118bbf None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:39.388604 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4315e-68a3-4322-bfae-a8ad31c0257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:39.389306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4315e-68a3-4322-bfae-a8ad31c0257d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:39.389576 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4315e-68a3-4322-bfae-a8ad31c0257d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:39.389842 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4315e-68a3-4322-bfae-a8ad31c0257d None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:39.390503 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4315e-68a3-4322-bfae-a8ad31c0257d None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:39.390798 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4315e-68a3-4322-bfae-a8ad31c0257d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:39.392874 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4315e-68a3-4322-bfae-a8ad31c0257d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:39.408405 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 202/398] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:39.413976 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd1687-194f-44e9-a27a-5e99626b7db8 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:39.526758 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:39.549888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd1687-194f-44e9-a27a-5e99626b7db8 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:39.572148 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950585-c138-418f-bc88-6dd78b6529a8 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:39.572449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950585-c138-418f-bc88-6dd78b6529a8 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:39.572703 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950585-c138-418f-bc88-6dd78b6529a8 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:39.574289 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 203/399] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:39.579017 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1395d77-ddd5-434d-91c1-70440afa0c4c None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:39.579296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1395d77-ddd5-434d-91c1-70440afa0c4c None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:39.580227 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1395d77-ddd5-434d-91c1-70440afa0c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:39.587153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5d26-d7a0-428c-a6ba-31038b3b15a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:39.587787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5d26-d7a0-428c-a6ba-31038b3b15a6 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:39.588098 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5d26-d7a0-428c-a6ba-31038b3b15a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:39.588368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5d26-d7a0-428c-a6ba-31038b3b15a6 None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:39.589502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5d26-d7a0-428c-a6ba-31038b3b15a6 None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:39.590938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5d26-d7a0-428c-a6ba-31038b3b15a6 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:39.592849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 197/400] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:39 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:39.598307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5d26-d7a0-428c-a6ba-31038b3b15a6 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:39.612420 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b1395d77-ddd5-434d-91c1-70440afa0c4c None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:39.614371 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b1395d77-ddd5-434d-91c1-70440afa0c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:39.701596 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 204/401] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:39.746813 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5d26-d7a0-428c-a6ba-31038b3b15a6 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:39.787561 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995afe3-1fe2-4df7-bb28-e3c3df6831a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:39.788222 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995afe3-1fe2-4df7-bb28-e3c3df6831a4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:39.788493 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995afe3-1fe2-4df7-bb28-e3c3df6831a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:39.788821 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995afe3-1fe2-4df7-bb28-e3c3df6831a4 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:39.789942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995afe3-1fe2-4df7-bb28-e3c3df6831a4 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:39.791499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995afe3-1fe2-4df7-bb28-e3c3df6831a4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:39.793517 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 198/402] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:39 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:39.801210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1395d77-ddd5-434d-91c1-70440afa0c4c None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:39.819276 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:39.925512 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1395d77-ddd5-434d-91c1-70440afa0c4c None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:39.964229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8362b97-f77b-4d39-a02b-45143d5ac873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:39.964885 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8362b97-f77b-4d39-a02b-45143d5ac873 None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:39.965159 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8362b97-f77b-4d39-a02b-45143d5ac873 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:39.965430 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8362b97-f77b-4d39-a02b-45143d5ac873 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/groups/dc394c7b1855430d98d20216daa7d98e/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:39.967334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8362b97-f77b-4d39-a02b-45143d5ac873 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf7de8d456645dab44a0fdc611d62bb, group_id=dc394c7b1855430d98d20216daa7d98e, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:39.968784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8362b97-f77b-4d39-a02b-45143d5ac873 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:39.993498 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbeda-5b56-4c3d-a0bc-eeb17533b63a None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:39.994213 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 205/403] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 00:15:39 2022] PUT /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/groups/dc394c7b1855430d98d20216daa7d98e/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:39.994670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbeda-5b56-4c3d-a0bc-eeb17533b63a None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:39.994926 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbeda-5b56-4c3d-a0bc-eeb17533b63a None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:39.997862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 199/404] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:40.005667 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5be88-9554-44bb-b3f0-3413218662d5 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:40.006285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5be88-9554-44bb-b3f0-3413218662d5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:40.006924 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5be88-9554-44bb-b3f0-3413218662d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:40.030750 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-a5f5be88-9554-44bb-b3f0-3413218662d5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:40.032384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-a5f5be88-9554-44bb-b3f0-3413218662d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:40.084653 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfbeda-5b56-4c3d-a0bc-eeb17533b63a None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:40.112727 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:40.146414 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 206/405] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:40.232902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfbeda-5b56-4c3d-a0bc-eeb17533b63a None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:40.271005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008969-f82f-433a-9105-c6979d54d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:40.272040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008969-f82f-433a-9105-c6979d54d05a None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:40.272510 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008969-f82f-433a-9105-c6979d54d05a None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:40.273025 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008969-f82f-433a-9105-c6979d54d05a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:40.284373 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c008969-f82f-433a-9105-c6979d54d05a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-2c008969-f82f-433a-9105-c6979d54d05a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:40.289565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:40.290430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:40.291288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:40.293843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 200/406] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:15:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:40.299594 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5be88-9554-44bb-b3f0-3413218662d5 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:40.304023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:40.415976 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5be88-9554-44bb-b3f0-3413218662d5 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:40.469250 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:40.471396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:40.472014 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:40.472507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:40.473383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:40.473936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:40.475507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:40.496386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 207/407] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:40.502109 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008969-f82f-433a-9105-c6979d54d05a None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:40.536959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:40.581484 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:40.605969 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:40.616518 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008969-f82f-433a-9105-c6979d54d05a None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:40.651409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d6308-5a17-49c3-9bc0-ccf6d0971188 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:40.658190 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c1a9-48af-47b7-805f-16da1dc223ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:40.659091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c1a9-48af-47b7-805f-16da1dc223ec None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:40.659528 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c1a9-48af-47b7-805f-16da1dc223ec None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:40.659967 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c1a9-48af-47b7-805f-16da1dc223ec None admin] PATH_INFO: `/v3/groups/18b3375310114650b848aa61d6056c8e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:40.661310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c1a9-48af-47b7-805f-16da1dc223ec None admin] RBAC: Authorizing `identity:get_group(group_id=18b3375310114650b848aa61d6056c8e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:40.662928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c1a9-48af-47b7-805f-16da1dc223ec None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:40.664979 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 201/408] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:40 2022] GET /identity/v3/groups/18b3375310114650b848aa61d6056c8e => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:40.670314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c1a9-48af-47b7-805f-16da1dc223ec None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:40.692944 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f055-0e09-4d70-8469-8f6f3cc8930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:40.693618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f055-0e09-4d70-8469-8f6f3cc8930c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:40.693895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f055-0e09-4d70-8469-8f6f3cc8930c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:40.694162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f055-0e09-4d70-8469-8f6f3cc8930c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:40.705571 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f055-0e09-4d70-8469-8f6f3cc8930c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-3933f055-0e09-4d70-8469-8f6f3cc8930c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:40.711019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:40.711938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:40.712839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 208/409] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:40.722058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f055-0e09-4d70-8469-8f6f3cc8930c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:40.805154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c1a9-48af-47b7-805f-16da1dc223ec None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:40.852232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a2aa5-b0b2-438b-b4e6-e7d0c3f10a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:40.856248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a2aa5-b0b2-438b-b4e6-e7d0c3f10a8b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:40.856667 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a2aa5-b0b2-438b-b4e6-e7d0c3f10a8b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:40.857075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a2aa5-b0b2-438b-b4e6-e7d0c3f10a8b None admin] PATH_INFO: `/v3/projects/b165c34800e2494a8f309a6e802bd8dd` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:40.858379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a2aa5-b0b2-438b-b4e6-e7d0c3f10a8b None admin] RBAC: Authorizing `identity:get_project(project_id=b165c34800e2494a8f309a6e802bd8dd)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:40.862216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a2aa5-b0b2-438b-b4e6-e7d0c3f10a8b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:40.866676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 202/410] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:40 2022] GET /identity/v3/projects/b165c34800e2494a8f309a6e802bd8dd => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:40.870949 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a2aa5-b0b2-438b-b4e6-e7d0c3f10a8b None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:40.890952 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:40.992860 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f055-0e09-4d70-8469-8f6f3cc8930c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:41.001121 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a2aa5-b0b2-438b-b4e6-e7d0c3f10a8b None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:41.024156 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:41.039780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c50de-9fe4-460e-99d3-469df46052d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:41.040471 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c50de-9fe4-460e-99d3-469df46052d0 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:41.040892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c50de-9fe4-460e-99d3-469df46052d0 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:41.041168 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c50de-9fe4-460e-99d3-469df46052d0 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:41.042184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c50de-9fe4-460e-99d3-469df46052d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:41.042498 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c50de-9fe4-460e-99d3-469df46052d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:41.044176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c50de-9fe4-460e-99d3-469df46052d0 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:41.047948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb43e0-c7ea-467e-bd6a-422ad6c2a77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:41.049364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb43e0-c7ea-467e-bd6a-422ad6c2a77d None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:41.050031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb43e0-c7ea-467e-bd6a-422ad6c2a77d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:41.050918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb43e0-c7ea-467e-bd6a-422ad6c2a77d None admin] PATH_INFO: `/v3/projects/b165c34800e2494a8f309a6e802bd8dd/groups/18b3375310114650b848aa61d6056c8e/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:41.053356 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb43e0-c7ea-467e-bd6a-422ad6c2a77d None admin] RBAC: Authorizing `identity:create_grant(project_id=b165c34800e2494a8f309a6e802bd8dd, group_id=18b3375310114650b848aa61d6056c8e, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:41.053738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 209/411] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:41.054979 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e57d4f-e14f-4c1c-aa57-6678bcdd1cea None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:41.055322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e57d4f-e14f-4c1c-aa57-6678bcdd1cea None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:41.055541 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e57d4f-e14f-4c1c-aa57-6678bcdd1cea None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:41.056073 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb43e0-c7ea-467e-bd6a-422ad6c2a77d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:41.056936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 210/412] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:41.060754 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e57d4f-e14f-4c1c-aa57-6678bcdd1cea None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:41.078284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 203/413] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 00:15:40 2022] PUT /identity/v3/projects/b165c34800e2494a8f309a6e802bd8dd/groups/18b3375310114650b848aa61d6056c8e/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:41.080102 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dadad-6f62-4d44-883f-3130c6ef6c4a None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:41.080760 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dadad-6f62-4d44-883f-3130c6ef6c4a None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:41.081235 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dadad-6f62-4d44-883f-3130c6ef6c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:41.121453 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-4d5dadad-6f62-4d44-883f-3130c6ef6c4a None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:41.125277 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-4d5dadad-6f62-4d44-883f-3130c6ef6c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:41.249526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e57d4f-e14f-4c1c-aa57-6678bcdd1cea None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:41.261622 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:41.289676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ad8c5-e8c1-4e1d-a250-350f2f3fc85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:41.290757 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ad8c5-e8c1-4e1d-a250-350f2f3fc85c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:41.291229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ad8c5-e8c1-4e1d-a250-350f2f3fc85c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:41.291692 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ad8c5-e8c1-4e1d-a250-350f2f3fc85c None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:41.293157 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ad8c5-e8c1-4e1d-a250-350f2f3fc85c None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:41.295042 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 204/414] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:41.295313 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ad8c5-e8c1-4e1d-a250-350f2f3fc85c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:41.297437 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 211/415] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:41 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:41.308049 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dadad-6f62-4d44-883f-3130c6ef6c4a None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:41.423102 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dadad-6f62-4d44-883f-3130c6ef6c4a None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:41.460053 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e792d4-0453-492e-9ba8-bdb38f8018e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:41.461045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e792d4-0453-492e-9ba8-bdb38f8018e1 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:41.461515 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e792d4-0453-492e-9ba8-bdb38f8018e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:41.461996 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e792d4-0453-492e-9ba8-bdb38f8018e1 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:41.463408 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e792d4-0453-492e-9ba8-bdb38f8018e1 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:41.465141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e792d4-0453-492e-9ba8-bdb38f8018e1 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:41.467269 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 205/416] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:41 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:41.475553 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ad8c5-e8c1-4e1d-a250-350f2f3fc85c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:41.543021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:41.593530 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ad8c5-e8c1-4e1d-a250-350f2f3fc85c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:41.630162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa1735-29f7-48d4-8d54-6ff4296b28f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:41.630823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1735-29f7-48d4-8d54-6ff4296b28f6 None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:41.631100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1735-29f7-48d4-8d54-6ff4296b28f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:41.631370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1735-29f7-48d4-8d54-6ff4296b28f6 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/groups/dc394c7b1855430d98d20216daa7d98e/roles/bc92a32951104b92b187e6cb51ef9bd8` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:41.633716 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa1735-29f7-48d4-8d54-6ff4296b28f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf7de8d456645dab44a0fdc611d62bb, group_id=dc394c7b1855430d98d20216daa7d98e, role_id=bc92a32951104b92b187e6cb51ef9bd8)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:41.635321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa1735-29f7-48d4-8d54-6ff4296b28f6 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:41.656945 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 212/417] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 00:15:41 2022] PUT /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb/groups/dc394c7b1855430d98d20216daa7d98e/roles/bc92a32951104b92b187e6cb51ef9bd8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:15:41.871307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e792d4-0453-492e-9ba8-bdb38f8018e1 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:41.947284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:41.990480 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e792d4-0453-492e-9ba8-bdb38f8018e1 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:42.037244 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fd93-6787-4f95-972a-747520dfc328 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:42.037900 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fd93-6787-4f95-972a-747520dfc328 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:42.038378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fd93-6787-4f95-972a-747520dfc328 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:42.040236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 213/418] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:42.042332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c940e42-03fb-49ad-8b12-beec24cada28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:42.042332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940e42-03fb-49ad-8b12-beec24cada28 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:42.042332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940e42-03fb-49ad-8b12-beec24cada28 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:42.042332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940e42-03fb-49ad-8b12-beec24cada28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:42.046571 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151a367-0b60-4e52-b93a-19d8c0a2a4df None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:42.047127 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151a367-0b60-4e52-b93a-19d8c0a2a4df None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:42.047625 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151a367-0b60-4e52-b93a-19d8c0a2a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:42.064450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c940e42-03fb-49ad-8b12-beec24cada28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-0c940e42-03fb-49ad-8b12-beec24cada28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:42.069602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:42.070472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:42.071253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:42.074116 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 206/419] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:42.082850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c940e42-03fb-49ad-8b12-beec24cada28 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:42.084052 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e151a367-0b60-4e52-b93a-19d8c0a2a4df None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:42.085843 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e151a367-0b60-4e52-b93a-19d8c0a2a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:42.212501 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 214/420] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:42.282120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c940e42-03fb-49ad-8b12-beec24cada28 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:42.324482 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:42.338053 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:42.339035 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:42.339515 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:42.340041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:42.340909 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] RBAC: Adding query filter params (name=member) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:42.341408 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:42.343031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:42.353059 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 207/421] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:42.359045 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151a367-0b60-4e52-b93a-19d8c0a2a4df None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:42.448257 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:42.538048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151a367-0b60-4e52-b93a-19d8c0a2a4df None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:42.585602 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27aaf2-5e9e-476a-b261-1de682f02814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:42.586719 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27aaf2-5e9e-476a-b261-1de682f02814 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:42.587518 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27aaf2-5e9e-476a-b261-1de682f02814 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:42.588319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27aaf2-5e9e-476a-b261-1de682f02814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:42.679657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27aaf2-5e9e-476a-b261-1de682f02814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:42.681638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27aaf2-5e9e-476a-b261-1de682f02814 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:42.756312 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:42.810038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:42.831641 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 215/422] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:42.838025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27aaf2-5e9e-476a-b261-1de682f02814 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:42.983306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388abfe4-b510-428e-a3b7-cf8f1a1cc8de None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:43.020683 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27aaf2-5e9e-476a-b261-1de682f02814 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:43.029017 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55823bd-8d7e-4e22-a686-b31cdd5310c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:43.029722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55823bd-8d7e-4e22-a686-b31cdd5310c3 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.029939 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55823bd-8d7e-4e22-a686-b31cdd5310c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.030214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55823bd-8d7e-4e22-a686-b31cdd5310c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.046246 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55823bd-8d7e-4e22-a686-b31cdd5310c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-b55823bd-8d7e-4e22-a686-b31cdd5310c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:43.051065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:43.052346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:43.053237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 208/423] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:43.054353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186416e6-1674-4170-8816-2dfee6022274 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.054353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186416e6-1674-4170-8816-2dfee6022274 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.054353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186416e6-1674-4170-8816-2dfee6022274 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.060064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 209/424] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:43.061376 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebedb0-13bc-4e81-a005-db6f4ecbf53b None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.061662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebedb0-13bc-4e81-a005-db6f4ecbf53b None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.061940 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebedb0-13bc-4e81-a005-db6f4ecbf53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.082127 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-28ebedb0-13bc-4e81-a005-db6f4ecbf53b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:43.083353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-28ebedb0-13bc-4e81-a005-db6f4ecbf53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:43.090270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4d7bb-f451-4e4c-85c3-4ffb64a0209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:43.091288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d7bb-f451-4e4c-85c3-4ffb64a0209a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.091768 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d7bb-f451-4e4c-85c3-4ffb64a0209a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.092288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d7bb-f451-4e4c-85c3-4ffb64a0209a None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.093682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4d7bb-f451-4e4c-85c3-4ffb64a0209a None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:43.096520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4d7bb-f451-4e4c-85c3-4ffb64a0209a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:43.103690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 216/425] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:42 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:43.104297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4d7bb-f451-4e4c-85c3-4ffb64a0209a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:43.123812 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:43.172737 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:43.210509 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 210/426] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:43.211959 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebedb0-13bc-4e81-a005-db6f4ecbf53b None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:43.239411 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4d7bb-f451-4e4c-85c3-4ffb64a0209a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:43.308569 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:43.309653 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.310132 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.310622 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.311488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:43.312027 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:43.314207 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:43.328580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 217/427] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:43.332977 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebedb0-13bc-4e81-a005-db6f4ecbf53b None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:43.335693 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:43.370189 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df672bf-f0ee-4f06-9152-651db22571be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:43.371139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df672bf-f0ee-4f06-9152-651db22571be None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.371248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df672bf-f0ee-4f06-9152-651db22571be None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.371462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df672bf-f0ee-4f06-9152-651db22571be None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.372681 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df672bf-f0ee-4f06-9152-651db22571be None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:43.374142 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df672bf-f0ee-4f06-9152-651db22571be None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:43.379875 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 211/428] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:43 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:43.382143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df672bf-f0ee-4f06-9152-651db22571be None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:43.476755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:43.489631 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:43.516532 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af83973-03d4-4ccd-83cf-cf53b47fafea None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:43.556774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899227-7c80-41f0-ad20-8fe1cfc73aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:43.558142 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899227-7c80-41f0-ad20-8fe1cfc73aed None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.558560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899227-7c80-41f0-ad20-8fe1cfc73aed None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.559022 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899227-7c80-41f0-ad20-8fe1cfc73aed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.633963 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df672bf-f0ee-4f06-9152-651db22571be None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:43.659984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a899227-7c80-41f0-ad20-8fe1cfc73aed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:43.661768 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a899227-7c80-41f0-ad20-8fe1cfc73aed None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:43.691422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:43.692577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.693113 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.693558 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.694757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] RBAC: Adding query filter params (group.id=dc394c7b1855430d98d20216daa7d98e, role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=303d80342777404a8a19015531902390) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:43.695780 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:43.697782 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:43.709360 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 212/429] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:43 2022] GET /identity/v3/role_assignments?group.id=dc394c7b1855430d98d20216daa7d98e&scope.project.id=303d80342777404a8a19015531902390&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 611 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:43.710673 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:43.800211 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:43.852319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 218/430] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:43.858053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899227-7c80-41f0-ad20-8fe1cfc73aed None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:43.892048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f477-7b8b-48f2-b0ec-5fab43bafb91 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:43.905100 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:43.943424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6238d-85a2-4746-b376-7e91267650e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:43.944124 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6238d-85a2-4746-b376-7e91267650e0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.944708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6238d-85a2-4746-b376-7e91267650e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.945016 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6238d-85a2-4746-b376-7e91267650e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.958779 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6238d-85a2-4746-b376-7e91267650e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-c9b6238d-85a2-4746-b376-7e91267650e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:43.965179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:43.966066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:43.966843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 213/431] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:43.968258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063168-f87e-475d-8314-48c22cdf9bcb None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.968258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063168-f87e-475d-8314-48c22cdf9bcb None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.968258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063168-f87e-475d-8314-48c22cdf9bcb None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.970318 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 214/432] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:43.976157 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7c9f-10c2-4d67-b7d4-da4784084990 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:43.976445 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7c9f-10c2-4d67-b7d4-da4784084990 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:43.977270 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7c9f-10c2-4d67-b7d4-da4784084990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:43.997656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899227-7c80-41f0-ad20-8fe1cfc73aed None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:43.999721 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-3a4d7c9f-10c2-4d67-b7d4-da4784084990 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:44.001194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-3a4d7c9f-10c2-4d67-b7d4-da4784084990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:44.044953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf205-2285-44a5-b916-70697d5cd45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:44.045597 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf205-2285-44a5-b916-70697d5cd45a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.047677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf205-2285-44a5-b916-70697d5cd45a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.047677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf205-2285-44a5-b916-70697d5cd45a None admin] PATH_INFO: `/v3/projects/303d80342777404a8a19015531902390` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.049059 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cf205-2285-44a5-b916-70697d5cd45a None admin] RBAC: Authorizing `identity:get_project(project_id=303d80342777404a8a19015531902390)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:44.050562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cf205-2285-44a5-b916-70697d5cd45a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:44.052397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 219/433] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:43 2022] GET /identity/v3/projects/303d80342777404a8a19015531902390 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:44.053084 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf205-2285-44a5-b916-70697d5cd45a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:44.099874 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 215/434] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:44.101244 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d7c9f-10c2-4d67-b7d4-da4784084990 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:44.112294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:44.193895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf205-2285-44a5-b916-70697d5cd45a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:44.226851 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:44.230441 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d7c9f-10c2-4d67-b7d4-da4784084990 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:44.243956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:44.245262 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.246000 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.246452 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.247759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] RBAC: Adding query filter params (name=member) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:44.248759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:44.250721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:44.266479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 220/435] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:44.268170 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:44.280434 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743462e-a3b7-4a95-b430-6009de3827d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:44.281048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743462e-a3b7-4a95-b430-6009de3827d2 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.281327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743462e-a3b7-4a95-b430-6009de3827d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.281590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743462e-a3b7-4a95-b430-6009de3827d2 None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.283458 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743462e-a3b7-4a95-b430-6009de3827d2 None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:44.285183 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743462e-a3b7-4a95-b430-6009de3827d2 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:44.287222 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 216/436] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:44 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:44.293649 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743462e-a3b7-4a95-b430-6009de3827d2 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:44.403920 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fd7db-fee7-41c6-adbf-07ae9cd2c264 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:44.408403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:44.423097 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743462e-a3b7-4a95-b430-6009de3827d2 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:44.448260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1566-1789-4bec-8531-9fdfaad8f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:44.448889 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1566-1789-4bec-8531-9fdfaad8f857 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.449135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1566-1789-4bec-8531-9fdfaad8f857 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.449403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1566-1789-4bec-8531-9fdfaad8f857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.481317 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:44.482621 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.483232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.483665 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.484456 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] RBAC: Adding query filter params (group.id=dc394c7b1855430d98d20216daa7d98e, role.id=bc92a32951104b92b187e6cb51ef9bd8, scope.project.id=303d80342777404a8a19015531902390) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:44.484775 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:44.487182 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:44.494550 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 217/437] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:44 2022] GET /identity/v3/role_assignments?group.id=dc394c7b1855430d98d20216daa7d98e&scope.project.id=303d80342777404a8a19015531902390&role.id=bc92a32951104b92b187e6cb51ef9bd8 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:44.494865 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:44.535318 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:44.557178 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a1566-1789-4bec-8531-9fdfaad8f857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:44.560229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a1566-1789-4bec-8531-9fdfaad8f857 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:44.620580 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e9a6-223b-4b9b-9a55-479eea320cf6 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:44.671470 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4ccc-65f3-4987-9bbe-b22d27cdc9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:44.672711 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4ccc-65f3-4987-9bbe-b22d27cdc9a3 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.673607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4ccc-65f3-4987-9bbe-b22d27cdc9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.673885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4ccc-65f3-4987-9bbe-b22d27cdc9a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.685416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4ccc-65f3-4987-9bbe-b22d27cdc9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-b27e4ccc-65f3-4987-9bbe-b22d27cdc9a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:44.690563 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:44.691442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:44.692247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 218/438] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:44.692884 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5c06d-ee5a-4220-a63e-f0c190b5f3d4 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.693255 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5c06d-ee5a-4220-a63e-f0c190b5f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.694344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5c06d-ee5a-4220-a63e-f0c190b5f3d4 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.694883 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 219/439] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:44.696565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 221/440] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 00:15:44.701994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5c06d-ee5a-4220-a63e-f0c190b5f3d4 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:44.702585 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d956c-845e-400c-b9cd-f5a5f2886125 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.702877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d956c-845e-400c-b9cd-f5a5f2886125 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.703152 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d956c-845e-400c-b9cd-f5a5f2886125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.712640 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:44.728587 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-c08d956c-845e-400c-b9cd-f5a5f2886125 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:44.729988 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-c08d956c-845e-400c-b9cd-f5a5f2886125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:44.812457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:44.821007 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 222/441] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:44.826035 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d956c-845e-400c-b9cd-f5a5f2886125 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:44.830928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5c06d-ee5a-4220-a63e-f0c190b5f3d4 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:44.876570 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:44.877201 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.877477 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.877746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.878411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:44.878709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:44.880095 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:44.888968 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 220/442] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:44.894641 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:44.947926 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d956c-845e-400c-b9cd-f5a5f2886125 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:44.992722 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ac19f-efcb-4599-8f41-153e3b822da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:44.993360 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ac19f-efcb-4599-8f41-153e3b822da3 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:44.993977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ac19f-efcb-4599-8f41-153e3b822da3 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:44.994283 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ac19f-efcb-4599-8f41-153e3b822da3 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:44.995556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ac19f-efcb-4599-8f41-153e3b822da3 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:44.999505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ac19f-efcb-4599-8f41-153e3b822da3 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:44.999505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 223/443] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:44 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:45.004897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ac19f-efcb-4599-8f41-153e3b822da3 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:45.010125 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:45.025527 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa9aa6-6d9a-4472-bf46-77ebc973a6cb None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.064365 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80fce1-1665-478c-96fe-756572110b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.065422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80fce1-1665-478c-96fe-756572110b64 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.065422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80fce1-1665-478c-96fe-756572110b64 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.065648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80fce1-1665-478c-96fe-756572110b64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.090970 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:45.116796 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ac19f-efcb-4599-8f41-153e3b822da3 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.140906 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80fce1-1665-478c-96fe-756572110b64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:45.143168 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80fce1-1665-478c-96fe-756572110b64 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:45.151030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7b6c-df04-46cd-a6f7-3c26d65c326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.151923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7b6c-df04-46cd-a6f7-3c26d65c326d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.152207 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7b6c-df04-46cd-a6f7-3c26d65c326d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.152480 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7b6c-df04-46cd-a6f7-3c26d65c326d None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.153606 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7b6c-df04-46cd-a6f7-3c26d65c326d None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:45.155036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7b6c-df04-46cd-a6f7-3c26d65c326d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:45.156820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 224/444] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:45.159681 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7b6c-df04-46cd-a6f7-3c26d65c326d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:45.229445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:45.243621 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 221/445] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 00:15:45.244502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80fce1-1665-478c-96fe-756572110b64 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:45.261411 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7b6c-df04-46cd-a6f7-3c26d65c326d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.296008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9a3e-3d8b-4477-842b-4124fde3e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.296783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9a3e-3d8b-4477-842b-4124fde3e105 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.297067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9a3e-3d8b-4477-842b-4124fde3e105 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.297349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9a3e-3d8b-4477-842b-4124fde3e105 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.297810 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:45.308383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a9a3e-3d8b-4477-842b-4124fde3e105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-6d9a9a3e-3d8b-4477-842b-4124fde3e105 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:45.313656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:45.314616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:45.315396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 225/446] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:45.316713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9a3e-3d8b-4477-842b-4124fde3e105 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:45.343638 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80fce1-1665-478c-96fe-756572110b64 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.379002 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.379589 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.379885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.380153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.380862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] RBAC: Adding query filter params (group.id=dc394c7b1855430d98d20216daa7d98e, role.id=811019b55bad4d3982f2f845fd434eb4, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:45.381164 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:45.382577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:45.388296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 222/447] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/role_assignments?group.id=dc394c7b1855430d98d20216daa7d98e&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=811019b55bad4d3982f2f845fd434eb4 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:45.389063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:45.445445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9a3e-3d8b-4477-842b-4124fde3e105 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.482388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:45.490123 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b520230-e6d0-4616-93bd-f620ebe03e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.490802 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b520230-e6d0-4616-93bd-f620ebe03e3d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.491080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b520230-e6d0-4616-93bd-f620ebe03e3d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.491349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b520230-e6d0-4616-93bd-f620ebe03e3d None admin] PATH_INFO: `/v3/projects/b165c34800e2494a8f309a6e802bd8dd` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.492596 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b520230-e6d0-4616-93bd-f620ebe03e3d None admin] RBAC: Authorizing `identity:get_project(project_id=b165c34800e2494a8f309a6e802bd8dd)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:45.494071 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b520230-e6d0-4616-93bd-f620ebe03e3d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:45.495963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 226/448] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/projects/b165c34800e2494a8f309a6e802bd8dd => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:45.501583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b520230-e6d0-4616-93bd-f620ebe03e3d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:45.516304 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ac0d-618c-4cc0-ad37-1caca0a1f733 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.538214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:45.557372 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.557981 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.558260 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.558528 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.559191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:45.559490 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:45.560989 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:45.569723 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 223/449] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:45.576143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:45.625001 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b520230-e6d0-4616-93bd-f620ebe03e3d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.668674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd3df7-9ff9-4ad9-b8c2-ca395cbab898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.669970 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd3df7-9ff9-4ad9-b8c2-ca395cbab898 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.670259 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd3df7-9ff9-4ad9-b8c2-ca395cbab898 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.670560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd3df7-9ff9-4ad9-b8c2-ca395cbab898 None admin] PATH_INFO: `/v3/groups/18b3375310114650b848aa61d6056c8e` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.671682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd3df7-9ff9-4ad9-b8c2-ca395cbab898 None admin] RBAC: Authorizing `identity:get_group(group_id=18b3375310114650b848aa61d6056c8e)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:45.673367 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd3df7-9ff9-4ad9-b8c2-ca395cbab898 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:45.675147 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 227/450] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/groups/18b3375310114650b848aa61d6056c8e => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:45.680998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd3df7-9ff9-4ad9-b8c2-ca395cbab898 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:45.691686 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd2b8d-6b2a-4eb2-836b-c1587c7c3844 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.734385 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f43f0-9674-4b9c-95af-f709b51f7848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.735239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f43f0-9674-4b9c-95af-f709b51f7848 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.735935 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f43f0-9674-4b9c-95af-f709b51f7848 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.736313 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f43f0-9674-4b9c-95af-f709b51f7848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.758831 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:45.797028 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:45.802538 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd3df7-9ff9-4ad9-b8c2-ca395cbab898 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:45.818296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f43f0-9674-4b9c-95af-f709b51f7848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:45.819748 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f43f0-9674-4b9c-95af-f709b51f7848 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:45.836230 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:45.836829 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:45.837105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:45.837383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:45.838096 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] RBAC: Adding query filter params (group.id=18b3375310114650b848aa61d6056c8e, role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=b165c34800e2494a8f309a6e802bd8dd) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:45.838402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:45.839805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:45.845970 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 228/451] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/role_assignments?group.id=18b3375310114650b848aa61d6056c8e&scope.project.id=b165c34800e2494a8f309a6e802bd8dd&role.id=952eea31fada4104858d315ac0f1296a => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:45.927331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 224/452] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 00:15:45.933366 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:46.055087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf51d-dee8-40d5-bbab-8483727a986f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:46.085229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:46.091324 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261abc-5aa4-4b12-b669-bd39cf75afa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:46.091980 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261abc-5aa4-4b12-b669-bd39cf75afa7 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:46.092255 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261abc-5aa4-4b12-b669-bd39cf75afa7 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:46.092521 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261abc-5aa4-4b12-b669-bd39cf75afa7 None admin] PATH_INFO: `/v3/projects/2bf7de8d456645dab44a0fdc611d62bb` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:46.093616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261abc-5aa4-4b12-b669-bd39cf75afa7 None admin] RBAC: Authorizing `identity:get_project(project_id=2bf7de8d456645dab44a0fdc611d62bb)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:46.095920 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261abc-5aa4-4b12-b669-bd39cf75afa7 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:46.097527 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 229/453] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 00:15:45 2022] GET /identity/v3/projects/2bf7de8d456645dab44a0fdc611d62bb => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:46.103189 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f43f0-9674-4b9c-95af-f709b51f7848 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:46.182435 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:46.201114 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f43f0-9674-4b9c-95af-f709b51f7848 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:46.233642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7fe51-4d36-414e-8604-e210617fbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:46.234270 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fe51-4d36-414e-8604-e210617fbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:46.234634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fe51-4d36-414e-8604-e210617fbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:46.234992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fe51-4d36-414e-8604-e210617fbcb5 None admin] PATH_INFO: `/v3/groups/dc394c7b1855430d98d20216daa7d98e` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:46.236299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7fe51-4d36-414e-8604-e210617fbcb5 None admin] RBAC: Authorizing `identity:get_group(group_id=dc394c7b1855430d98d20216daa7d98e)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:46.237933 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7fe51-4d36-414e-8604-e210617fbcb5 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:46.239486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 225/454] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 00:15:46 2022] GET /identity/v3/groups/dc394c7b1855430d98d20216daa7d98e => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:46.245346 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261abc-5aa4-4b12-b669-bd39cf75afa7 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:46.344141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261abc-5aa4-4b12-b669-bd39cf75afa7 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:46.376542 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89afb8-e757-494a-9915-c2f885b449c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:46.377324 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89afb8-e757-494a-9915-c2f885b449c8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:46.377601 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89afb8-e757-494a-9915-c2f885b449c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:46.377868 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89afb8-e757-494a-9915-c2f885b449c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:46.378575 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89afb8-e757-494a-9915-c2f885b449c8 None admin] RBAC: Adding query filter params (group.id=dc394c7b1855430d98d20216daa7d98e, role.id=bc92a32951104b92b187e6cb51ef9bd8, scope.project.id=2bf7de8d456645dab44a0fdc611d62bb) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:46.378879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89afb8-e757-494a-9915-c2f885b449c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:46.380334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89afb8-e757-494a-9915-c2f885b449c8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:46.385790 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 230/455] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 00:15:46 2022] GET /identity/v3/role_assignments?group.id=dc394c7b1855430d98d20216daa7d98e&scope.project.id=2bf7de8d456645dab44a0fdc611d62bb&role.id=bc92a32951104b92b187e6cb51ef9bd8 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:49.019201 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e46d7-f45b-4269-8d80-20d2d0b818c3 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.019719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e46d7-f45b-4269-8d80-20d2d0b818c3 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.019719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e46d7-f45b-4269-8d80-20d2d0b818c3 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.021349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 226/456] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:49.026725 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390797b4-b3d6-48e8-81da-91900239a606 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.027562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390797b4-b3d6-48e8-81da-91900239a606 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.028076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390797b4-b3d6-48e8-81da-91900239a606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.049275 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-390797b4-b3d6-48e8-81da-91900239a606 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:49.050881 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-390797b4-b3d6-48e8-81da-91900239a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:49.119281 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:49.131618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 231/457] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:49.221274 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c17a2-c287-4456-a0eb-e7a46ac77aac None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.221920 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c17a2-c287-4456-a0eb-e7a46ac77aac None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.222392 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c17a2-c287-4456-a0eb-e7a46ac77aac None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.224199 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 227/458] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:49.229133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3670-4837-4143-a069-b4749561fea7 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.229640 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3670-4837-4143-a069-b4749561fea7 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.230104 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3670-4837-4143-a069-b4749561fea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.248719 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-8e7d3670-4837-4143-a069-b4749561fea7 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:49.250212 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-8e7d3670-4837-4143-a069-b4749561fea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:49.327638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 232/459] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:49.456459 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b712bf-8b33-4c12-8c2f-cfc5aac02461 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.456782 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b712bf-8b33-4c12-8c2f-cfc5aac02461 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.457014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b712bf-8b33-4c12-8c2f-cfc5aac02461 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.458570 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 228/460] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:49.464159 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c698-b6c7-4768-be0d-32d685c5ef59 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.464742 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c698-b6c7-4768-be0d-32d685c5ef59 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.465219 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c698-b6c7-4768-be0d-32d685c5ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.470526 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b712bf-8b33-4c12-8c2f-cfc5aac02461 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:49.496821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e020c698-b6c7-4768-be0d-32d685c5ef59 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:49.498019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e020c698-b6c7-4768-be0d-32d685c5ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:49.604733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 233/461] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:49.630880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b712bf-8b33-4c12-8c2f-cfc5aac02461 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:49.666919 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:49.667771 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.668246 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.668656 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.678104 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020c698-b6c7-4768-be0d-32d685c5ef59 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:49.680981 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:49.683341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:49.694081 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:49.702661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:49.703800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:49.705349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:49.705349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:49.705349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:49.705862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 229/462] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:49.712267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:49.745569 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:49.798055 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020c698-b6c7-4768-be0d-32d685c5ef59 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:49.826881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38372-f59d-4efb-b0bb-ee4930a4018f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:49.841386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec04d8b-219a-47a2-8fc3-27e009820edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:49.842308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec04d8b-219a-47a2-8fc3-27e009820edd None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.842682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec04d8b-219a-47a2-8fc3-27e009820edd None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.842957 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec04d8b-219a-47a2-8fc3-27e009820edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.857328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec04d8b-219a-47a2-8fc3-27e009820edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:49.858728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec04d8b-219a-47a2-8fc3-27e009820edd None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:49.866831 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6870-5575-4e6b-a19c-18cd3f5019e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:49.867434 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6870-5575-4e6b-a19c-18cd3f5019e2 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.867718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6870-5575-4e6b-a19c-18cd3f5019e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.868037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6870-5575-4e6b-a19c-18cd3f5019e2 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.868679 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6870-5575-4e6b-a19c-18cd3f5019e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:49.868981 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6870-5575-4e6b-a19c-18cd3f5019e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:49.870327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6870-5575-4e6b-a19c-18cd3f5019e2 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-8ec04d8b-219a-47a2-8fc3-27e009820edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:49.874415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:49.875272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:49.876696 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:49.876696 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:49.876696 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:49.879864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 234/463] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:49.879864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1847-e115-4c38-ba02-d2a897807a63 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.879864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1847-e115-4c38-ba02-d2a897807a63 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.879864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1847-e115-4c38-ba02-d2a897807a63 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.885378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 235/464] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:49.885703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 230/465] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:49.886356 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1847-e115-4c38-ba02-d2a897807a63 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:49.887220 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaee143-8e02-4183-8501-02a8667bcc2d None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:49.887648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaee143-8e02-4183-8501-02a8667bcc2d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:49.888106 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaee143-8e02-4183-8501-02a8667bcc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:49.906471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-adaee143-8e02-4183-8501-02a8667bcc2d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:49.907936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-adaee143-8e02-4183-8501-02a8667bcc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:49.969802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:49.980505 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 231/466] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:49.981298 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaee143-8e02-4183-8501-02a8667bcc2d None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:50.010010 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1847-e115-4c38-ba02-d2a897807a63 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.013736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:50.055452 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.056145 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.056345 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.056825 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.057468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:50.057771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.059141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.089025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 236/467] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:50.090126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:50.098529 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaee143-8e02-4183-8501-02a8667bcc2d None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.134957 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e4f55-f567-442f-9d5b-80a0fa1b212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.135489 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e4f55-f567-442f-9d5b-80a0fa1b212c None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.135769 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e4f55-f567-442f-9d5b-80a0fa1b212c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.136316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e4f55-f567-442f-9d5b-80a0fa1b212c None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.136960 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e4f55-f567-442f-9d5b-80a0fa1b212c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.138395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e4f55-f567-442f-9d5b-80a0fa1b212c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.161753 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 232/468] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:49 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:50.164747 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e4f55-f567-442f-9d5b-80a0fa1b212c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:50.210985 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc01b2-5abe-46dc-be44-fddef145b0b8 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.238990 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:50.276026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.277041 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.277738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.278237 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.295374 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.298113 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.309478 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e4f55-f567-442f-9d5b-80a0fa1b212c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:50.322620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:50.323581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:50.325144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:50.325144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:50.325144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:50.330465 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 237/469] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:50.331325 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:50.350824 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1b1f4-585b-4adb-9a86-0a0c9002307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.351438 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b1f4-585b-4adb-9a86-0a0c9002307b None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.351718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b1f4-585b-4adb-9a86-0a0c9002307b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.352024 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b1f4-585b-4adb-9a86-0a0c9002307b None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.352671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1b1f4-585b-4adb-9a86-0a0c9002307b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.353092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:50.354108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1b1f4-585b-4adb-9a86-0a0c9002307b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.378024 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 233/470] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:50 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:50.379293 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1b1f4-585b-4adb-9a86-0a0c9002307b None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:50.459874 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84774-6f57-4903-bbf2-d927d628a50c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.513025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.513825 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.514210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.514591 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.525575 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1b1f4-585b-4adb-9a86-0a0c9002307b None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.528384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:50.530382 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.532471 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:50.553320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:50.554517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:50.555362 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:50.555362 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:50.555362 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:50.557751 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 238/471] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:50.566398 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:50.574317 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.574928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.575204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.575477 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.576183 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:50.576483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.578552 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.595458 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 234/472] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:50.601579 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:50.655731 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:50.694819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679d007-12d5-44c8-9d22-7cbd8ba6b1e2 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.730598 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.731125 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.731409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.731684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.732362 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:50.732663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.734106 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.734398 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601a11b-fb0d-4d4f-8f8e-569af0b5b5fc None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.747077 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 239/473] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:50.753680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:50.780874 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4fa67-e4ce-4fa0-bf91-02cf4b2ad45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.781483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4fa67-e4ce-4fa0-bf91-02cf4b2ad45d None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.781889 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4fa67-e4ce-4fa0-bf91-02cf4b2ad45d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.782074 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4fa67-e4ce-4fa0-bf91-02cf4b2ad45d None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.782708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4fa67-e4ce-4fa0-bf91-02cf4b2ad45d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.784289 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4fa67-e4ce-4fa0-bf91-02cf4b2ad45d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.808857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 235/474] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:50 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:15:50.894054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d418a-e557-4663-860d-f985e65e5539 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:50.926006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:50.936381 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b150-95bf-44df-8423-8a2ebb9ad823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:50.936996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b150-95bf-44df-8423-8a2ebb9ad823 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:50.937269 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b150-95bf-44df-8423-8a2ebb9ad823 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:50.937533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b150-95bf-44df-8423-8a2ebb9ad823 None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:50.938283 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b150-95bf-44df-8423-8a2ebb9ad823 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:50.940416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b150-95bf-44df-8423-8a2ebb9ad823 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:50.964974 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 240/475] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:15:50 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:52.521039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07695b7-11e8-4b2e-823f-688a03e74444 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:52.522016 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07695b7-11e8-4b2e-823f-688a03e74444 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:52.522486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07695b7-11e8-4b2e-823f-688a03e74444 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:52.524441 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 236/476] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:52.529600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bf7f-240d-4b4f-89ed-fdb3a4d9341b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:52.530037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bf7f-240d-4b4f-89ed-fdb3a4d9341b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:52.530207 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bf7f-240d-4b4f-89ed-fdb3a4d9341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:52.550733 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-4161bf7f-240d-4b4f-89ed-fdb3a4d9341b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:52.551977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-4161bf7f-240d-4b4f-89ed-fdb3a4d9341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:52.631363 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 241/477] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:52.769522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b66e-5ed3-4d41-ae49-79c0e4addda6 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:52.769810 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b66e-5ed3-4d41-ae49-79c0e4addda6 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:52.770070 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b66e-5ed3-4d41-ae49-79c0e4addda6 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:52.771669 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 237/478] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:52.777175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddd07-2395-4686-9d68-65d7a4cd5667 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:52.777692 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddd07-2395-4686-9d68-65d7a4cd5667 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:52.778183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddd07-2395-4686-9d68-65d7a4cd5667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:52.797764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-128ddd07-2395-4686-9d68-65d7a4cd5667 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:52.799265 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-128ddd07-2395-4686-9d68-65d7a4cd5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:52.873761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 242/479] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:52.964464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6b66e-5ed3-4d41-ae49-79c0e4addda6 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:52.986681 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:53.089444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6b66e-5ed3-4d41-ae49-79c0e4addda6 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:53.129795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9c8c-f5dc-4973-93a3-5f794aa41186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:53.130860 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9c8c-f5dc-4973-93a3-5f794aa41186 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.131331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9c8c-f5dc-4973-93a3-5f794aa41186 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.131861 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9c8c-f5dc-4973-93a3-5f794aa41186 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.143541 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9c8c-f5dc-4973-93a3-5f794aa41186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-1d1c9c8c-f5dc-4973-93a3-5f794aa41186 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:53.148887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:53.149871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:53.150648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:53.153338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 238/480] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:15:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:53.161779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ddd07-2395-4686-9d68-65d7a4cd5667 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:53.211165 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:53.212195 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9c8c-f5dc-4973-93a3-5f794aa41186 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:53.273160 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ddd07-2395-4686-9d68-65d7a4cd5667 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:53.300235 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:53.308657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1bfb4-501e-42a6-b1c2-0873e5db3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:53.309260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1bfb4-501e-42a6-b1c2-0873e5db3470 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.309535 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1bfb4-501e-42a6-b1c2-0873e5db3470 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.309807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1bfb4-501e-42a6-b1c2-0873e5db3470 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.310490 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1bfb4-501e-42a6-b1c2-0873e5db3470 None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:53.310786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1bfb4-501e-42a6-b1c2-0873e5db3470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:53.312179 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1bfb4-501e-42a6-b1c2-0873e5db3470 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:53.320613 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 243/481] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:15:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:53.324432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2883-d950-430a-89c0-ed239b03a320 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.324432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2883-d950-430a-89c0-ed239b03a320 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.324597 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9c8c-f5dc-4973-93a3-5f794aa41186 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:53.324672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2883-d950-430a-89c0-ed239b03a320 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.324672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 244/482] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:53.324955 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bbb7b-fb53-43fb-a4aa-af21ec11aa3a None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.325177 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bbb7b-fb53-43fb-a4aa-af21ec11aa3a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.325498 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bbb7b-fb53-43fb-a4aa-af21ec11aa3a None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.326672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 245/483] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:53.327353 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bbb7b-fb53-43fb-a4aa-af21ec11aa3a None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:53.358896 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfabce-ebc6-4d0c-bfac-430bee38f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:53.359430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfabce-ebc6-4d0c-bfac-430bee38f977 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.359717 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfabce-ebc6-4d0c-bfac-430bee38f977 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.360550 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfabce-ebc6-4d0c-bfac-430bee38f977 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.370579 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfabce-ebc6-4d0c-bfac-430bee38f977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-08cfabce-ebc6-4d0c-bfac-430bee38f977 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:53.379961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:53.381007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:53.381844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 239/484] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:15:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:53.382754 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec65d-2264-4930-b0cc-782992d0599f None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.382843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec65d-2264-4930-b0cc-782992d0599f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.383063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec65d-2264-4930-b0cc-782992d0599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.400275 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-25cec65d-2264-4930-b0cc-782992d0599f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:53.401471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-25cec65d-2264-4930-b0cc-782992d0599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:53.433186 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bbb7b-fb53-43fb-a4aa-af21ec11aa3a None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:53.440767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:53.467392 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 240/485] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:53.467847 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:53.468487 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.468654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9d40a-d44b-4884-a027-359df5b290fd None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.468749 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.468931 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9d40a-d44b-4884-a027-359df5b290fd None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.469026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.469789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9d40a-d44b-4884-a027-359df5b290fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.486924 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:53.488481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:53.496422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-aca9d40a-d44b-4884-a027-359df5b290fd None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:53.497623 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-aca9d40a-d44b-4884-a027-359df5b290fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:53.503858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:53.504712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:53.505567 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:53.505567 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:53.505567 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:53.505567 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 246/486] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:53.505782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:53.571447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:53.581247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 241/487] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:53.582993 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9d40a-d44b-4884-a027-359df5b290fd None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:53.636391 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd75ea-bc62-4538-b0de-eb3ec1b1a310 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:53.675158 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:53.675769 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.676074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.676348 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.677008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:53.677311 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:53.678923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:53.687500 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 247/488] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:15:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:53.692902 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:53.717037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:53.748880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9d40a-d44b-4884-a027-359df5b290fd None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:53.801725 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:53.803096 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.803690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.804162 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.805240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:53.806177 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:53.808314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:53.811868 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aae7cd-793c-437a-8949-a1bf6183b47f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:53.825035 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 242/489] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:53.830629 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:53.851971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:53.852905 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.853441 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.853776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.866110 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:53.868264 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:53.886984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:53.887916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:53.888755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:53.888755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:53.888755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:53.891296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 248/490] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:53.892214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:53.898670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:53.944958 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ed43b-9fc1-4c7d-a446-a8a3bf0a66e6 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:53.966252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:53.978356 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:53.978977 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:53.979259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:53.979531 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:53.987986 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:53.989425 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:53.996201 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8fbb1-bc61-42d3-845b-3291109c878c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:15:54.002412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:54.003284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:54.004188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 243/491] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 00:15:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:54.005017 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.033487 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe9a4-9611-4bec-9ce6-24c016bd7513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.034107 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe9a4-9611-4bec-9ce6-24c016bd7513 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.034385 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe9a4-9611-4bec-9ce6-24c016bd7513 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.034657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe9a4-9611-4bec-9ce6-24c016bd7513 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.044917 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebe9a4-9611-4bec-9ce6-24c016bd7513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-33ebe9a4-9611-4bec-9ce6-24c016bd7513 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:54.050877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:54.051909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:54.052685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 249/492] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:15:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:54.053337 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe9a4-9611-4bec-9ce6-24c016bd7513 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.107488 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe91a2-1494-4950-93a5-ae6e366e8c17 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.130182 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:54.148278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.148800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.149070 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.149336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.149964 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:54.150259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.151627 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.163681 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 244/493] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:54.165966 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe9a4-9611-4bec-9ce6-24c016bd7513 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.166980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.195966 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:54.201487 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532d3e1-828a-4f8d-9a1e-43870fa3ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.202120 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d3e1-828a-4f8d-9a1e-43870fa3ac51 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.202402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d3e1-828a-4f8d-9a1e-43870fa3ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.202672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d3e1-828a-4f8d-9a1e-43870fa3ac51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.213726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532d3e1-828a-4f8d-9a1e-43870fa3ac51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-d532d3e1-828a-4f8d-9a1e-43870fa3ac51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:54.218809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:54.219732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:54.220579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 250/494] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:54.221239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532d3e1-828a-4f8d-9a1e-43870fa3ac51 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.268332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff0f6-2b8b-4094-ae30-bfdf6842e20a None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.302009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.302608 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.302889 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.303161 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.303915 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:54.304223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.305662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.322573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532d3e1-828a-4f8d-9a1e-43870fa3ac51 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.344954 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 245/495] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:54.345787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.356407 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.357023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.357295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.357564 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.358218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:54.358518 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.359959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.367741 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 251/496] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:54.368552 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.386942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:54.425542 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:54.454932 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812cb32-dfbf-4fbd-8c0b-02cc83eaf43f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.479163 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8b51-b2d4-45ed-b572-2d721706bde1 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.489866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.490484 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.490756 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.491020 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] PATH_INFO: `/v3/users/glance` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.498163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.499618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:15:54.511457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:54.512560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 246/497] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:54.513460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.515615 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.516921 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.517197 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.517534 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.518265 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:54.518527 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.519929 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.528286 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 252/498] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:54.529132 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.613145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:54.619444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff5550-f197-4dd7-bb75-05cbf233b22c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.627386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a1f5b-e5bd-4bea-ad9e-bbe035d7802c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.643717 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:54.654055 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aa184-e042-4f47-be3f-3960f8711044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.654647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aa184-e042-4f47-be3f-3960f8711044 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.654921 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aa184-e042-4f47-be3f-3960f8711044 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.655187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aa184-e042-4f47-be3f-3960f8711044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.661341 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.661958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.662237 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.662510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.673670 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.675133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:54.689708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:54.690739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:54.691998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:54.691998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:54.691998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:54.691998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 253/499] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:54.691998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.725091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426aa184-e042-4f47-be3f-3960f8711044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.726547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426aa184-e042-4f47-be3f-3960f8711044 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.791317 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24254c82-a5e0-40aa-b1e8-78264ff5b9d9 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.818792 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:54.825462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 247/500] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:54.826278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aa184-e042-4f47-be3f-3960f8711044 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.831180 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.831792 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.832101 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.832374 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.833113 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:54.833418 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.834852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.871399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 254/501] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:54.872260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:54.900169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:54.928863 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aa184-e042-4f47-be3f-3960f8711044 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.964168 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:54.964697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:54.964969 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:54.965242 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:54.973617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197168f-e271-4da2-a774-2c7e8c67f831 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:54.975050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:54.976520 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:54.990795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:54.991684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:54.992837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:54.992837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:54.992837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:54.992837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 248/502] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:54.993204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.010630 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.011229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.011510 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.011783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.012449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:55.012750 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.014122 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.025956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 255/503] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:55.026906 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.042850 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.093469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c256-4a87-40d3-9581-b13e88d5aa04 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.113350 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.128861 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.129117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4c52c-e7d1-45af-ab58-2c228e311075 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.129478 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.129761 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.130037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.140438 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.142039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:55.155869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:55.157367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:55.158461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:55.158461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:55.158461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:55.158461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 249/504] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:55.158461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.166746 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7d916-a9d4-4036-9bdc-e283ceb0b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.167354 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d916-a9d4-4036-9bdc-e283ceb0b523 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.167644 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d916-a9d4-4036-9bdc-e283ceb0b523 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.167933 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d916-a9d4-4036-9bdc-e283ceb0b523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.235417 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7d916-a9d4-4036-9bdc-e283ceb0b523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.236846 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7d916-a9d4-4036-9bdc-e283ceb0b523 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.256756 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.259771 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598d38-344e-4c03-9b45-b135c415f7a8 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.293969 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.294819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.295098 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.295371 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.296040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:55.296353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.297764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.309351 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 250/505] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:55.310258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.319403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.336226 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 256/506] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:55.337049 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7d916-a9d4-4036-9bdc-e283ceb0b523 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.414636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f716b-1e5b-4f1e-a725-39dcb143d204 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.435116 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7d916-a9d4-4036-9bdc-e283ceb0b523 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.449360 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.449987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.450263 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.450546 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.457817 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.459245 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:15:55.470789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:55.471694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:55.472606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 251/507] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:55.473163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.477457 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.478152 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.478436 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.478713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.479390 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:55.479650 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.481092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.493479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 257/508] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:55.494218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.500209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.542574 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.580832 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecf830-6206-45d1-bcb6-a480343c6ba8 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.596322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aff680-7a86-4a1f-839e-26ee62c2f070 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.614115 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.614730 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.615010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.615284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.622788 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.624363 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.629400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.630019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.630297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.630562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:15:55.635341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:55.636327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 252/509] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:55.637216 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.645600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.647067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:55.662026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:55.662910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:55.663744 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:55.663744 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:55.663744 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:55.663744 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 258/510] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:55.663988 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.720639 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.739913 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519d117-e6e6-4e33-baed-f55c986b623e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.763652 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.768781 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124ed4e-8faa-4757-9ab4-df8ec493e991 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.778501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.779104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.779388 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.779663 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.780425 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:55.780732 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.782294 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.799950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 253/511] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:55.800759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.802786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.803410 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.803687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.804007 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.810953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.812456 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:15:55.824626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:55.826218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 259/512] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:55.828033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.907438 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa5d73-fe90-432c-ba22-2d1b3bd4483e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.931866 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8802db-7af8-4335-91d6-b31bee83094a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:55.941701 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.942290 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.942562 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.942827 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.943547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:55.943868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.945280 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.953244 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:55.964202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 254/513] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:55.965045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:55.970736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:55.971349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:55.971629 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:55.971934 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:55.972583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:55.973554 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:55.974954 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:55.988445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 260/514] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:55.989413 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.009212 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.068893 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee55780-90e3-4d34-813b-bcd4426c2041 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.092440 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c53265-b71d-4511-96fb-cdef6e676fb8 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.103699 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38a7b-fea5-43be-8dfb-86dc81d4f8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.104443 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38a7b-fea5-43be-8dfb-86dc81d4f8aa None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.104842 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38a7b-fea5-43be-8dfb-86dc81d4f8aa None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.105218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38a7b-fea5-43be-8dfb-86dc81d4f8aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.127322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.127961 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.128239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.128509 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.129197 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:56.129499 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.131027 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.164129 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 261/515] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:56.164129 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.180176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.187135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38a7b-fea5-43be-8dfb-86dc81d4f8aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.188791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38a7b-fea5-43be-8dfb-86dc81d4f8aa None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.238589 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.260608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97287a7c-8c01-4b12-a093-d09e5c98cab4 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.292096 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 255/516] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:56.293252 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38a7b-fea5-43be-8dfb-86dc81d4f8aa None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.301214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735bb6b-8ed3-4611-baf8-e53ccf0cb780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.301816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735bb6b-8ed3-4611-baf8-e53ccf0cb780 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.302104 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735bb6b-8ed3-4611-baf8-e53ccf0cb780 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.302352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735bb6b-8ed3-4611-baf8-e53ccf0cb780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.369035 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735bb6b-8ed3-4611-baf8-e53ccf0cb780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.370422 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735bb6b-8ed3-4611-baf8-e53ccf0cb780 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.387143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.394376 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38a7b-fea5-43be-8dfb-86dc81d4f8aa None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.429506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.430221 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.430499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.430787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.437283 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.439217 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.448375 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:15:56.450802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:56.451798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 256/517] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:56.452888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.474704 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 262/518] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:15:56.475702 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735bb6b-8ed3-4611-baf8-e53ccf0cb780 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.557973 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d00767-8141-4364-86b3-38f5b311a557 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.574019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735bb6b-8ed3-4611-baf8-e53ccf0cb780 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.591918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.592514 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.592793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.593065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.593783 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=d8c2ac1eccaf4ffd88d49b119da41cae) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:56.594115 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.595849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.601148 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 257/519] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/role_assignments?user.id=d8c2ac1eccaf4ffd88d49b119da41cae&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:56.602033 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.610269 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.610921 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.611799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.612131 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.624799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.627064 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.627220 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:56.644579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:56.645556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:56.646811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:56.646811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:56.646811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:56.646811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 263/520] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:56.647031 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.681445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.725453 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9562-1c71-4eaf-a080-413e3b36bec7 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.768058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce58f05-11f6-41e3-bfb7-1758858fd132 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.771714 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.772369 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.772649 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.772918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.773609 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:56.773910 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.775344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.800094 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 258/521] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:56.800951 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.814874 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.815505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.815788 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.816102 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.827561 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.830350 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:56.845477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:56.846395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:56.852373 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:56.852373 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:56.852373 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:56.852373 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 264/522] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:56.852373 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.895749 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.918476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe618357-b92e-4b06-aa70-24ba0553a89f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.936814 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:56.956761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7682-ac07-4ab0-a737-61afc4a29590 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:56.956958 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e18621-ed68-4789-b942-45accc924288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.957505 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18621-ed68-4789-b942-45accc924288 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.957780 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18621-ed68-4789-b942-45accc924288 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:56.958149 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18621-ed68-4789-b942-45accc924288 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:56.958789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e18621-ed68-4789-b942-45accc924288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:56.959210 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e18621-ed68-4789-b942-45accc924288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:56.960603 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e18621-ed68-4789-b942-45accc924288 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:56.974469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 259/523] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:56.975315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e18621-ed68-4789-b942-45accc924288 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:56.998343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:56.999504 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:56.999791 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:57.000111 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:57.001553 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=2e31af0d7f814b0b86140be2c2d64f2d) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:57.002028 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:57.004098 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:57.017743 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 265/524] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/role_assignments?user.id=2e31af0d7f814b0b86140be2c2d64f2d&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:57.017743 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:57.093125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e18621-ed68-4789-b942-45accc924288 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:57.140553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:57.142824 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:57.143120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:57.143395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:57.144081 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:57.144382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:57.146377 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:57.159291 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:57.170055 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c316e-cd2e-4b96-9fe9-7f8efd44c279 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:57.171577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 260/525] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:57.173154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:57.222709 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:57.224287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:57.225184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:57.225680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:57.238543 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:57.240853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:15:57.256321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:57.257209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:57.258058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:15:57.258058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:15:57.258058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:15:57.258058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:15:57.258058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:15:57.258058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:15:57.258058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:57.258058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:57.259910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 266/526] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:57.263434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:57.279006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:57.298965 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700708e-f94f-4400-a4a9-96c3a59450ae None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:57.346484 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:57.347191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:57.347811 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:57.348190 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:57.357108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:57.359183 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:15:57.374039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:57.374998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:57.377238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 261/527] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:57.384746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:57.397830 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eddc8-73b0-46be-8a38-98128604edaa None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:57.442124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:57.443194 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:57.443721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:57.444193 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:57.445441 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:57.445901 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:57.447799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:57.466583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 267/528] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:57.468108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:57.477404 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:57.523515 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb140b5-3b66-4bd9-aec0-5c52a24dd0e9 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:57.566405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:57.567058 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:57.567364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:57.567620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:57.568315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:57.568610 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:57.570223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:57.574327 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:57.584805 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 262/529] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:57.590843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:57.626564 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2631-4293-48f9-be98-bb4d569a3b7e None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:57.675797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1df4c-6808-46d4-8491-ec8183982999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:57.677185 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1df4c-6808-46d4-8491-ec8183982999 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:57.678169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1df4c-6808-46d4-8491-ec8183982999 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:57.678676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1df4c-6808-46d4-8491-ec8183982999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:57.680072 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1df4c-6808-46d4-8491-ec8183982999 None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=0c2c8ea12b814b0f9abaaa2a2b8cd3cb) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:57.680593 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1df4c-6808-46d4-8491-ec8183982999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:57.682891 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1df4c-6808-46d4-8491-ec8183982999 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:57.691147 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 268/530] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:57 2022] GET /identity/v3/role_assignments?user.id=0c2c8ea12b814b0f9abaaa2a2b8cd3cb&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:57.720233 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11b75f-ec50-4a37-9571-85d29986466d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:57.746143 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:57.764527 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0feb3e-67c0-4243-b272-2a813870011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:57.765176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0feb3e-67c0-4243-b272-2a813870011a None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:57.765480 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0feb3e-67c0-4243-b272-2a813870011a None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:57.765757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0feb3e-67c0-4243-b272-2a813870011a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:57.767070 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0feb3e-67c0-4243-b272-2a813870011a None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=5c0f0416eaed4d8eaa78daa33fcf06b9) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:57.767533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0feb3e-67c0-4243-b272-2a813870011a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:57.769009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0feb3e-67c0-4243-b272-2a813870011a None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:57.775729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 263/531] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:15:57 2022] GET /identity/v3/role_assignments?user.id=5c0f0416eaed4d8eaa78daa33fcf06b9&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:58.866277 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340fa3d-bdae-4d3b-aec1-3f593cd3102e None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:58.866921 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340fa3d-bdae-4d3b-aec1-3f593cd3102e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:58.866921 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340fa3d-bdae-4d3b-aec1-3f593cd3102e None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:58.868440 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 269/532] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:58.873810 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cf03-53f9-4985-86d8-76867809039a None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:58.874258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cf03-53f9-4985-86d8-76867809039a None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:58.874352 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cf03-53f9-4985-86d8-76867809039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:58.896837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-a060cf03-53f9-4985-86d8-76867809039a None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:58.898086 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-a060cf03-53f9-4985-86d8-76867809039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:58.973261 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 264/533] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:15:59.300759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91ef6-ccd5-486b-bc73-826e24c2a457 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:59.301147 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91ef6-ccd5-486b-bc73-826e24c2a457 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:59.301352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91ef6-ccd5-486b-bc73-826e24c2a457 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:59.302906 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 270/534] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:59.306082 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060cf03-53f9-4985-86d8-76867809039a None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:59.307729 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b949a8-2012-45a1-afe1-4828636cec9b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:59.308058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b949a8-2012-45a1-afe1-4828636cec9b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:59.308338 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b949a8-2012-45a1-afe1-4828636cec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:59.326468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-41b949a8-2012-45a1-afe1-4828636cec9b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:59.327682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-41b949a8-2012-45a1-afe1-4828636cec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:59.398240 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 271/535] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:15:59.414214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060cf03-53f9-4985-86d8-76867809039a None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:59.429032 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:59.450454 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065431ba-e3ea-462d-a4ab-f38aa5f2a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:59.451081 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065431ba-e3ea-462d-a4ab-f38aa5f2a858 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:59.451358 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065431ba-e3ea-462d-a4ab-f38aa5f2a858 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:59.451629 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065431ba-e3ea-462d-a4ab-f38aa5f2a858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:59.462686 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065431ba-e3ea-462d-a4ab-f38aa5f2a858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-065431ba-e3ea-462d-a4ab-f38aa5f2a858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:59.467336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:59.468375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:59.470034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 265/536] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:15:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:59.476182 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b949a8-2012-45a1-afe1-4828636cec9b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:59.539389 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:59.587001 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b949a8-2012-45a1-afe1-4828636cec9b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:59.623005 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:59.623617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:59.623925 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:59.624200 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:59.624865 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:59.625717 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:59.627252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:59.636904 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 272/537] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:15:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:59.643099 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065431ba-e3ea-462d-a4ab-f38aa5f2a858 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:59.749749 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065431ba-e3ea-462d-a4ab-f38aa5f2a858 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:59.767303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:59.789742 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:59.790802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:59.791347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:59.791865 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:59.806135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:59.808838 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:15:59.829648 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:59.830636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:15:59.831464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:15:59.831464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:15:59.831464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:15:59.838227 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 266/538] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:59.840781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:59.884521 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:59.907328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1981-d80b-4e3e-973a-29d86ec45372 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:59.941107 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:59.956409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd224cf-fbe0-4501-8412-7d928b4749f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:59.957196 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd224cf-fbe0-4501-8412-7d928b4749f4 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:59.957574 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd224cf-fbe0-4501-8412-7d928b4749f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:59.957949 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd224cf-fbe0-4501-8412-7d928b4749f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:59.969799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd224cf-fbe0-4501-8412-7d928b4749f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-1fd224cf-fbe0-4501-8412-7d928b4749f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:15:59.975195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:59.976297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:15:59.977256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:15:59.983699 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 273/539] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:15:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:59.985307 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd224cf-fbe0-4501-8412-7d928b4749f4 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:59.999538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e1c9d-e408-42ee-a1ed-f94f409b4a72 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.037572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc649453-aab8-433c-b18b-e37e3b5b3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.038177 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649453-aab8-433c-b18b-e37e3b5b3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.038505 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649453-aab8-433c-b18b-e37e3b5b3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.038781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649453-aab8-433c-b18b-e37e3b5b3ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.039535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc649453-aab8-433c-b18b-e37e3b5b3ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:00.039881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc649453-aab8-433c-b18b-e37e3b5b3ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.041347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc649453-aab8-433c-b18b-e37e3b5b3ac5 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.055085 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 267/540] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:00.056154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8380c-58b9-4675-a51a-3f1056a3827c None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.056435 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8380c-58b9-4675-a51a-3f1056a3827c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.056705 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8380c-58b9-4675-a51a-3f1056a3827c None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.062073 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 268/541] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:00.062073 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8380c-58b9-4675-a51a-3f1056a3827c None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.097595 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd224cf-fbe0-4501-8412-7d928b4749f4 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.131362 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf542c-caaa-4cde-bcba-5e3962e05e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.131987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf542c-caaa-4cde-bcba-5e3962e05e17 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.132267 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf542c-caaa-4cde-bcba-5e3962e05e17 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.132538 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf542c-caaa-4cde-bcba-5e3962e05e17 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.133198 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf542c-caaa-4cde-bcba-5e3962e05e17 None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:00.133500 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf542c-caaa-4cde-bcba-5e3962e05e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.134900 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf542c-caaa-4cde-bcba-5e3962e05e17 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.143177 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 274/542] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:15:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:00.145125 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c086e-1df7-4147-91de-a3763d6e9088 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.145413 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c086e-1df7-4147-91de-a3763d6e9088 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.145686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c086e-1df7-4147-91de-a3763d6e9088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.150199 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:00.165129 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-723c086e-1df7-4147-91de-a3763d6e9088 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:00.166326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-723c086e-1df7-4147-91de-a3763d6e9088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:00.167749 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8380c-58b9-4675-a51a-3f1056a3827c None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.211136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7980-fcb2-49b9-9793-98e067682e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.211512 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:00.212450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7980-fcb2-49b9-9793-98e067682e53 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.212744 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7980-fcb2-49b9-9793-98e067682e53 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.213084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7980-fcb2-49b9-9793-98e067682e53 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.220954 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e7980-fcb2-49b9-9793-98e067682e53 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.222399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e7980-fcb2-49b9-9793-98e067682e53 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-008e7980-fcb2-49b9-9793-98e067682e53 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:00.233671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:00.234694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 269/543] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21663-58e0-4995-a385-5ee72a78f1eb None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.240784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21663-58e0-4995-a385-5ee72a78f1eb None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.241444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21663-58e0-4995-a385-5ee72a78f1eb None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.241444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 270/544] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:00.241444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21663-58e0-4995-a385-5ee72a78f1eb None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.241625 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 275/545] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:00.244819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c086e-1df7-4147-91de-a3763d6e9088 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.350277 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21663-58e0-4995-a385-5ee72a78f1eb None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.355974 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c086e-1df7-4147-91de-a3763d6e9088 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.387652 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.388302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.388581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.388853 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.393506 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35b3e-7c32-44ff-9ddc-7352e210aabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.394106 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35b3e-7c32-44ff-9ddc-7352e210aabf None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.394382 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35b3e-7c32-44ff-9ddc-7352e210aabf None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.394651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35b3e-7c32-44ff-9ddc-7352e210aabf None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.395425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35b3e-7c32-44ff-9ddc-7352e210aabf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:00.395729 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35b3e-7c32-44ff-9ddc-7352e210aabf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.397218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35b3e-7c32-44ff-9ddc-7352e210aabf None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.400767 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.402204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.408718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:00.420794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 276/546] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:00.420794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7403af5-3a6b-429d-a14a-7ebae946a8d6 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:00.421037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:00.421839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:00.422718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:00.422718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:00.422718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:00.422883 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7403af5-3a6b-429d-a14a-7ebae946a8d6 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.422883 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7403af5-3a6b-429d-a14a-7ebae946a8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.423010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 271/547] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:00.424620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.441054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-f7403af5-3a6b-429d-a14a-7ebae946a8d6 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:00.442235 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-f7403af5-3a6b-429d-a14a-7ebae946a8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:00.473937 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:00.520528 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 277/548] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:00.521372 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7403af5-3a6b-429d-a14a-7ebae946a8d6 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.546451 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eea10-625e-446e-87c0-b50c5f4286a9 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.583481 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.584135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.584416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.584691 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.596264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.597709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:00.613150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:00.614031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:00.614842 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:00.614842 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:00.614842 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:00.614842 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 272/549] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:00.615065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.656793 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7403af5-3a6b-429d-a14a-7ebae946a8d6 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.668179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:00.699331 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.700278 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.700711 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.701235 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.702118 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:00.702562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.704134 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.716300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 278/550] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:00.717251 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.726399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf1e1-1bc2-4a0c-949f-399326a88512 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.745873 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:00.761297 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d72ec-e571-406e-afb8-92f7c3fd330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.761913 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d72ec-e571-406e-afb8-92f7c3fd330b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.762186 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d72ec-e571-406e-afb8-92f7c3fd330b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.762455 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d72ec-e571-406e-afb8-92f7c3fd330b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.773503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d72ec-e571-406e-afb8-92f7c3fd330b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-394d72ec-e571-406e-afb8-92f7c3fd330b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:00.778612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:00.779472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 273/551] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:00.780647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d72ec-e571-406e-afb8-92f7c3fd330b None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.843053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0becf30-5a18-44cd-ab78-a52e99feee70 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.877094 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.877697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.877897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.878168 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.878801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:00.879097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.880490 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.894260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 279/552] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:00.895066 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.896490 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d72ec-e571-406e-afb8-92f7c3fd330b None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:00.908489 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:00.932422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:00.933037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:00.933317 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:00.933591 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:00.941757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:00.943219 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:00.954626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:00.956159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 274/553] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:00.958010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:00.985928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.010719 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eca8c6-b2e6-4ba5-a2b5-60595aea856d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.047570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.048284 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.048563 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.048830 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.049485 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:01.049789 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.051153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.067761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 280/554] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:01.067761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.075221 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f89226-7d8a-4960-b763-bd67dbc79575 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.110339 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b371-e435-48d9-b02e-d80e2a94c917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.110958 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b371-e435-48d9-b02e-d80e2a94c917 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.111240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b371-e435-48d9-b02e-d80e2a94c917 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.111514 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b371-e435-48d9-b02e-d80e2a94c917 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.122259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b371-e435-48d9-b02e-d80e2a94c917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-3ef6b371-e435-48d9-b02e-d80e2a94c917 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:01.128267 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:01.129207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:01.130014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 275/555] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:01.130674 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b371-e435-48d9-b02e-d80e2a94c917 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.166866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.176236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1732f2-3361-42db-9a4a-8227f7d9d26e None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.214050 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.214684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.214966 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.215239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.222976 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.224502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:01.235659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:01.236811 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:01.237657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 281/556] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:01.238134 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.241409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.249148 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b371-e435-48d9-b02e-d80e2a94c917 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.287176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.287855 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.288593 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.288875 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.289616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:01.289926 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.292074 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.313121 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 276/557] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:01.313580 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.360962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66318a-48e6-4146-8943-15997d926c3a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.394229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.394787 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.395065 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.395340 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.405827 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.407852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.410108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:01.421858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:01.423425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:01.424296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:01.424296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:01.424296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:01.424296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 282/558] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:01.424296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.424615 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fefca2-0dc4-45fc-bf5d-33165c86b648 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.458613 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.459210 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.459491 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.459762 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.460461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] RBAC: Adding query filter params (name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:01.460765 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.462126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.475475 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 277/559] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:01.475475 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.487740 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.533340 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216142cb-c2fa-4708-9311-a317a3ac398a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.568489 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.569089 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.569369 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.569651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.570335 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:01.570641 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.572098 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.576631 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581fd02-123f-4fc1-a5a6-af8fb5e16b89 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.584294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 283/560] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:01.585015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.611092 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.611716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.612024 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.612289 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.622588 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.624049 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:01.638428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:01.639519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:01.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:01.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:01.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:01.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 278/561] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:01.640687 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.646611 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.685226 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23be5bd-b2c9-4c48-b758-d0ff512d67ff None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.702761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.721072 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.721681 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.721958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.722229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.722867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:01.723168 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.724578 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.736246 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 284/562] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:01.737036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.751860 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d598e-1d50-4d5d-8989-df7e65bc8b43 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.785620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.786233 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.786529 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.786779 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.798362 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.799801 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:01.813891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:01.814998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:01.816139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:01.816139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:01.816139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:01.819626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 279/563] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:01.820354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.841324 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2949f7-c0a7-4303-8c20-c1f7a5d1f70b None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.875157 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.876377 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbf00a-f9ec-43fb-b356-351090699e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.877229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf00a-f9ec-43fb-b356-351090699e32 None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.877581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf00a-f9ec-43fb-b356-351090699e32 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.877907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf00a-f9ec-43fb-b356-351090699e32 None admin] PATH_INFO: `/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/d8c2ac1eccaf4ffd88d49b119da41cae/roles/1c927c2c8e3e4083a5617863d2d3e08f` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.892823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf00a-f9ec-43fb-b356-351090699e32 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ee46bb5a5b04e239bf1ef96355c8080, user_id=d8c2ac1eccaf4ffd88d49b119da41cae, role_id=1c927c2c8e3e4083a5617863d2d3e08f)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.894254 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf00a-f9ec-43fb-b356-351090699e32 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.907156 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 285/564] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:16:01 2022] PUT /identity/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/d8c2ac1eccaf4ffd88d49b119da41cae/roles/1c927c2c8e3e4083a5617863d2d3e08f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:16:01.907949 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbf00a-f9ec-43fb-b356-351090699e32 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:01.924565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3664-b866-4376-a805-df8cc33c1c42 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:01.941322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:01.963762 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:01.964414 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:01.964696 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:01.965095 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:01.965633 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:01.965939 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:01.967375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:01.987706 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 280/565] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:01.987706 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.040935 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbf00a-f9ec-43fb-b356-351090699e32 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.083122 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.084076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.084907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.084907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.096887 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.098536 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.110518 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defbcaf-6dcb-4d46-aff0-503828d074d6 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:02.113175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:02.114143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:16:02.115076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:02.119112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 286/566] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:02.120306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.128695 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:02.150746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.151353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.151636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.151941 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.152588 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:02.152888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.154263 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.166641 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 281/567] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:02.167392 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.225259 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:02.243947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b2d37-e03c-4ae3-91ba-c782c748edf3 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.280000 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.281140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.281140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.281385 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.293165 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.294892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:02.310864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:02.311853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 287/568] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:02.313412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.323321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64110fcd-d226-4b3e-a791-ccf7dc2311c3 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.357945 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.358547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.358827 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.359100 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.360365 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:02.360676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.362103 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.380583 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 282/569] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:02.381416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.413140 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:02.429434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15edda-c7e6-4381-bf4c-8befc3e3d604 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.466935 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.467563 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.467857 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.468136 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.485633 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.487162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.491332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9dbb-a25e-4206-bc62-44b1065c889e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:02.499432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:02.501221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 288/570] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:02.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.511807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:02.536558 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.537324 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.537912 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.538196 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.539055 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:02.539365 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.540817 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.554619 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 283/571] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:02.555729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.618076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1c529-ea94-4143-8ac3-58030afcd41c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.647702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:02.657210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.657972 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.658224 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d95919-a99b-4236-80cd-7afdf1112c6e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.658358 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.658520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.670677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.673081 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:02.688117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:02.689023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:02.689892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:02.689892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:02.689892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:02.689892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 289/572] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:02.689892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.698811 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.699887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.700411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.700754 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.701557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:02.702219 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.703556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.721587 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 284/573] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:02.722386 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.759167 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:02.806139 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c1be-d13b-494e-8d25-89df44470c4d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.827782 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e2ee6-7d7c-4745-8242-bd98a052ed25 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:02.842162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efea01-9d95-458c-857d-9cf16edf2c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.842818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efea01-9d95-458c-857d-9cf16edf2c2f None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.843097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efea01-9d95-458c-857d-9cf16edf2c2f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.843376 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efea01-9d95-458c-857d-9cf16edf2c2f None admin] PATH_INFO: `/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/2e31af0d7f814b0b86140be2c2d64f2d/roles/1c927c2c8e3e4083a5617863d2d3e08f` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.858303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efea01-9d95-458c-857d-9cf16edf2c2f None admin] RBAC: Authorizing `identity:create_grant(project_id=9ee46bb5a5b04e239bf1ef96355c8080, user_id=2e31af0d7f814b0b86140be2c2d64f2d, role_id=1c927c2c8e3e4083a5617863d2d3e08f)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.860460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efea01-9d95-458c-857d-9cf16edf2c2f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.863530 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:02.864153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:02.864430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:02.864699 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:02.865349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:02.865820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:02.867338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:02.874096 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 290/574] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:16:02 2022] PUT /identity/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/2e31af0d7f814b0b86140be2c2d64f2d/roles/1c927c2c8e3e4083a5617863d2d3e08f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:16:02.874894 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efea01-9d95-458c-857d-9cf16edf2c2f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.892477 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 285/575] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:02.896992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:02.920262 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:03.005820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efea01-9d95-458c-857d-9cf16edf2c2f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:03.017663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:03.042406 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27e043-59af-45d3-8272-31a1915acee3 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:03.061006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:03.061695 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:03.062098 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:03.062551 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:03.075485 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:03.076999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:03.088540 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:03.089182 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:03.089535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:03.089815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:03.097474 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:03.097666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:03.098780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:03.100187 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:03.100187 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:03.100187 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:03.100421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:03.100513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 291/576] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:03.105274 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:03.115387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:03.116522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:03.117532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 286/577] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:03.125056 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:03.199693 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:03.225893 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a2e7-69d0-4dec-921f-67c2314aba74 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:03.236547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6b377-5786-4db9-aa2e-4ce4df7f2bef None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:03.264073 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:03.264938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:03.265408 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:03.266688 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:03.267578 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:03.268048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:03.269697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:03.273407 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:03.274085 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:03.274435 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:03.274778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:03.275540 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:03.275996 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:03.277488 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:03.289574 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 292/578] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:03.290884 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:03.295764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 287/579] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:03.296690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:03.315742 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:03.403693 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8a1b7-8088-46f9-ac1f-c32dc3c2930f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:03.408978 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06254f09-32f0-4662-adb2-79a3473c3c91 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:03.444204 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:03.445023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:03.446412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:03.446869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:03.447301 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:03.453163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0addd1-9c55-4c02-a189-55ae880a8295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:03.453971 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0addd1-9c55-4c02-a189-55ae880a8295 None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:03.454315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0addd1-9c55-4c02-a189-55ae880a8295 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:03.454652 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0addd1-9c55-4c02-a189-55ae880a8295 None admin] PATH_INFO: `/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/0c2c8ea12b814b0f9abaaa2a2b8cd3cb/roles/1c927c2c8e3e4083a5617863d2d3e08f` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:03.455624 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:03.457171 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:03.468458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:03.470524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:03.471686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:03.471686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:03.471686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:03.471686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:03.471686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:03.471686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:03.471686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:03.471686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:03.475856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0addd1-9c55-4c02-a189-55ae880a8295 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ee46bb5a5b04e239bf1ef96355c8080, user_id=0c2c8ea12b814b0f9abaaa2a2b8cd3cb, role_id=1c927c2c8e3e4083a5617863d2d3e08f)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:03.475856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0addd1-9c55-4c02-a189-55ae880a8295 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:03.480452 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 293/580] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:03.481460 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:03.499623 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 288/581] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:16:03 2022] PUT /identity/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/0c2c8ea12b814b0f9abaaa2a2b8cd3cb/roles/1c927c2c8e3e4083a5617863d2d3e08f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:16:03.578521 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:03.594881 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ae3de-db42-4013-9bb0-77edcc436692 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:03.633867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6effc9c-bcbc-4941-989c-45092cc62c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:03.634544 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effc9c-bcbc-4941-989c-45092cc62c15 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:03.634828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effc9c-bcbc-4941-989c-45092cc62c15 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:03.635099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effc9c-bcbc-4941-989c-45092cc62c15 None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:03.635795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6effc9c-bcbc-4941-989c-45092cc62c15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:03.636126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6effc9c-bcbc-4941-989c-45092cc62c15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:03.637600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6effc9c-bcbc-4941-989c-45092cc62c15 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:03.651972 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 294/582] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:03.658024 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0addd1-9c55-4c02-a189-55ae880a8295 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:03.778734 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0addd1-9c55-4c02-a189-55ae880a8295 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:03.817583 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dcba7-78f9-4c23-a51f-6b6e0023045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:03.818237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dcba7-78f9-4c23-a51f-6b6e0023045d None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:03.818516 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dcba7-78f9-4c23-a51f-6b6e0023045d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:03.818787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dcba7-78f9-4c23-a51f-6b6e0023045d None admin] PATH_INFO: `/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/5c0f0416eaed4d8eaa78daa33fcf06b9/roles/1c927c2c8e3e4083a5617863d2d3e08f` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:03.834226 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dcba7-78f9-4c23-a51f-6b6e0023045d None admin] RBAC: Authorizing `identity:create_grant(project_id=9ee46bb5a5b04e239bf1ef96355c8080, user_id=5c0f0416eaed4d8eaa78daa33fcf06b9, role_id=1c927c2c8e3e4083a5617863d2d3e08f)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:03.835730 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dcba7-78f9-4c23-a51f-6b6e0023045d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:03.852110 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 289/583] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:16:03 2022] PUT /identity/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/5c0f0416eaed4d8eaa78daa33fcf06b9/roles/1c927c2c8e3e4083a5617863d2d3e08f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:16:04.237326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965533c-58bb-4187-9b28-a92559c5d66e None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:04.237326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965533c-58bb-4187-9b28-a92559c5d66e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:04.237911 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965533c-58bb-4187-9b28-a92559c5d66e None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:04.239616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 295/584] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:04.245503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32aa8-4fcb-4511-91da-3ea60cba6fd8 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:04.245975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32aa8-4fcb-4511-91da-3ea60cba6fd8 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:04.246076 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32aa8-4fcb-4511-91da-3ea60cba6fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:04.265336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f0a32aa8-4fcb-4511-91da-3ea60cba6fd8 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:04.267313 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f0a32aa8-4fcb-4511-91da-3ea60cba6fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:04.297570 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:04.347080 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 290/585] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:16:04.678043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965533c-58bb-4187-9b28-a92559c5d66e None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:04.789743 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965533c-58bb-4187-9b28-a92559c5d66e None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:04.824325 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80751c-476c-4f2b-bacf-d0c9217bc24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:04.824960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80751c-476c-4f2b-bacf-d0c9217bc24e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:04.825242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80751c-476c-4f2b-bacf-d0c9217bc24e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:04.825513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80751c-476c-4f2b-bacf-d0c9217bc24e None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:04.834162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:04.840777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80751c-476c-4f2b-bacf-d0c9217bc24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-9b80751c-476c-4f2b-bacf-d0c9217bc24e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:04.846771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:04.847898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:04.848907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:04.851094 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 296/586] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:04.856700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a32aa8-4fcb-4511-91da-3ea60cba6fd8 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:04.961667 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a32aa8-4fcb-4511-91da-3ea60cba6fd8 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:04.999165 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:05.000566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.000980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.001348 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.002124 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] RBAC: Adding query filter params (name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:05.002524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:05.003981 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:05.013262 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 291/587] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:05.019134 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80751c-476c-4f2b-bacf-d0c9217bc24e None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:05.133316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80751c-476c-4f2b-bacf-d0c9217bc24e None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:05.168197 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4507ce-612b-4ecb-ba83-02f793ba88da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:05.168912 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4507ce-612b-4ecb-ba83-02f793ba88da None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.169518 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4507ce-612b-4ecb-ba83-02f793ba88da None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.169859 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4507ce-612b-4ecb-ba83-02f793ba88da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.186553 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4507ce-612b-4ecb-ba83-02f793ba88da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:05.188696 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4507ce-612b-4ecb-ba83-02f793ba88da None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-0f4507ce-612b-4ecb-ba83-02f793ba88da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:05.204697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:05.205820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:05.207015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:05.207015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:05.207015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:05.210551 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 297/588] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:05.212142 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:05.238100 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:05.293401 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004e6b-6fb9-445d-8ebc-67a9e78eedf5 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.293911 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004e6b-6fb9-445d-8ebc-67a9e78eedf5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.293911 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004e6b-6fb9-445d-8ebc-67a9e78eedf5 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.295507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 298/589] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:05.301425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f526f32-4411-4cb3-a6af-81f497f7a736 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.301948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f526f32-4411-4cb3-a6af-81f497f7a736 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.302424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f526f32-4411-4cb3-a6af-81f497f7a736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.320796 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-6f526f32-4411-4cb3-a6af-81f497f7a736 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:05.322307 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-6f526f32-4411-4cb3-a6af-81f497f7a736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:05.325858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21106856-d276-4d80-9806-a078b9ec1c22 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:05.363632 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:05.364276 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.364550 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.365075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.365722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:05.366081 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:05.367435 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:05.385766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 292/590] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:05.387550 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:05.387766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:05.423972 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 299/591] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:05.490371 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:05.512128 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f329-3e14-4643-b674-f346fd09f59d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:05.549310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:05.550274 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.550792 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.551354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.559015 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:05.560699 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:05.577104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:05.578230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:05.579172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 293/592] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 00:16:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:05.586032 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f526f32-4411-4cb3-a6af-81f497f7a736 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:05.694929 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f526f32-4411-4cb3-a6af-81f497f7a736 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:05.739895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:05.740882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.741564 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.742385 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.744093 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:05.744711 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:05.746407 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:05.769214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 300/593] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 00:16:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:05.776258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:05.785254 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:05.840713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:05.901564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a76ed-6608-4856-b0a3-c16cfa90fe66 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:05.905832 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af993e0-0c6d-452e-87d0-e7e62d7a47ee None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:05.939305 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debfac7-eab4-4795-8e60-ffaf29c57901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:05.940044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debfac7-eab4-4795-8e60-ffaf29c57901 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.940388 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debfac7-eab4-4795-8e60-ffaf29c57901 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.940669 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debfac7-eab4-4795-8e60-ffaf29c57901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.944888 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a10b38-8c94-47d5-9921-1f4695964c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:05.945509 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10b38-8c94-47d5-9921-1f4695964c06 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.945784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10b38-8c94-47d5-9921-1f4695964c06 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.946053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10b38-8c94-47d5-9921-1f4695964c06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.954453 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:05.956109 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a10b38-8c94-47d5-9921-1f4695964c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-e4a10b38-8c94-47d5-9921-1f4695964c06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:05.960795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:05.961712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:05.962548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 301/594] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:05.963888 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c81c-9566-467f-8ee1-41d7f04e4a9e None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:05.963888 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c81c-9566-467f-8ee1-41d7f04e4a9e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:05.964067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c81c-9566-467f-8ee1-41d7f04e4a9e None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:05.965348 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 302/595] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:05.970014 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785c81c-9566-467f-8ee1-41d7f04e4a9e None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.021978 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debfac7-eab4-4795-8e60-ffaf29c57901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:06.023343 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debfac7-eab4-4795-8e60-ffaf29c57901 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:06.078006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:06.082999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785c81c-9566-467f-8ee1-41d7f04e4a9e None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:06.125706 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:06.126326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.126661 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.126879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.127703 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:06.127915 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:06.129296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:06.138286 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 294/596] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:16:06.139458 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996f7a-482f-47e0-a3ea-9e7f35093812 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.139750 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996f7a-482f-47e0-a3ea-9e7f35093812 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.140063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996f7a-482f-47e0-a3ea-9e7f35093812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.143939 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 303/597] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:06.144769 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.164153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-78996f7a-482f-47e0-a3ea-9e7f35093812 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:06.165361 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-78996f7a-482f-47e0-a3ea-9e7f35093812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:06.204566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:06.248188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 295/598] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:06.249481 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996f7a-482f-47e0-a3ea-9e7f35093812 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.282419 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e4e4e-7920-4eec-9288-8a5d2346bc70 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:06.333924 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970a330-57c2-40df-a327-b9f44c7da9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:06.334567 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a330-57c2-40df-a327-b9f44c7da9d0 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.334832 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a330-57c2-40df-a327-b9f44c7da9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.335123 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a330-57c2-40df-a327-b9f44c7da9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.352592 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970a330-57c2-40df-a327-b9f44c7da9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:06.355374 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970a330-57c2-40df-a327-b9f44c7da9d0 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-6970a330-57c2-40df-a327-b9f44c7da9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:06.374205 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:06.375752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:06.376695 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:06.376695 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:06.376695 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:06.376695 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 304/599] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:06.377639 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3fa6c-7a2f-438c-b77e-38386462daa2 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.377921 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3fa6c-7a2f-438c-b77e-38386462daa2 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.378191 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3fa6c-7a2f-438c-b77e-38386462daa2 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.379578 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 305/600] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:06.381788 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3fa6c-7a2f-438c-b77e-38386462daa2 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.401994 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:06.405149 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996f7a-482f-47e0-a3ea-9e7f35093812 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:06.465670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9a812-ae32-4434-b81d-7eb5a3777b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:06.466614 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9a812-ae32-4434-b81d-7eb5a3777b5d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.467056 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9a812-ae32-4434-b81d-7eb5a3777b5d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.467382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9a812-ae32-4434-b81d-7eb5a3777b5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.484206 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9a812-ae32-4434-b81d-7eb5a3777b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:06.485757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9a812-ae32-4434-b81d-7eb5a3777b5d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-0ae9a812-ae32-4434-b81d-7eb5a3777b5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:06.502812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:06.503947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:06.505018 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:06.505018 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:06.505018 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:06.506179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 296/601] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:06.507245 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183156-f049-4058-9523-11e97625e027 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.507571 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183156-f049-4058-9523-11e97625e027 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.507961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183156-f049-4058-9523-11e97625e027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.524084 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3fa6c-7a2f-438c-b77e-38386462daa2 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:06.527574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-3e183156-f049-4058-9523-11e97625e027 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:06.529047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-3e183156-f049-4058-9523-11e97625e027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:06.550352 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:06.561645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:06.562813 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.563198 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.563477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.564142 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:06.564438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:06.565796 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:06.582840 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 306/602] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:06.582840 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.608227 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 297/603] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:06.620041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e183156-f049-4058-9523-11e97625e027 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.657864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:06.686359 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c4250-e827-49dc-82ec-1a75ec9a521f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:06.713072 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e183156-f049-4058-9523-11e97625e027 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:06.724461 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:06.725243 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.725690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.726212 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.727207 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:06.727656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:06.729294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:06.746009 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 307/604] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:06.746953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.749248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:06.750450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.750786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.751138 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.757918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:06.759372 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:06.770367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:06.771236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:06.772203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:06.772203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:06.772203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:06.772203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:06.772203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:06.772203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:06.772203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:06.772203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:06.776180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 298/605] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:06.777006 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.792319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:06.862399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc7c9d-6cf6-48c8-9744-e771603393c5 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:06.886797 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b742-9ebb-437f-956b-58e526e86634 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:06.898469 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac38c9c-47c0-443b-831c-41b886dd81b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:06.899077 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac38c9c-47c0-443b-831c-41b886dd81b6 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.899356 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac38c9c-47c0-443b-831c-41b886dd81b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.899627 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac38c9c-47c0-443b-831c-41b886dd81b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.901500 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:06.913043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac38c9c-47c0-443b-831c-41b886dd81b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-dac38c9c-47c0-443b-831c-41b886dd81b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:06.918233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:06.919400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 308/606] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:06.920782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac38c9c-47c0-443b-831c-41b886dd81b6 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:06.931203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:06.932008 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:06.932382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:06.932745 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:06.940589 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:06.942119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:06.955886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:06.957009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:06.958126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 299/607] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:06.959709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.022384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac38c9c-47c0-443b-831c-41b886dd81b6 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.035275 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:07.056694 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.057294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.057572 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.057844 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.058528 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:07.058830 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.060319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.061218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00462f24-2b1d-4657-bdb7-15681d3b48c0 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.073118 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 309/608] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:07.073716 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.095511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.096132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.096409 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.096676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.097322 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] RBAC: Adding query filter params (name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:07.097617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.098969 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.106787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 300/609] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:07.107561 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.137527 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:07.182565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826c5e6-b4da-4a0f-858f-54a754e175a7 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.207362 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e21e7-7cc4-4861-a486-9898d850c440 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.217509 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42852bce-f4b8-4fe2-9ab7-49f9ceda8ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.218202 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852bce-f4b8-4fe2-9ab7-49f9ceda8ecd None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.219055 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852bce-f4b8-4fe2-9ab7-49f9ceda8ecd None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.219319 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852bce-f4b8-4fe2-9ab7-49f9ceda8ecd None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.229891 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42852bce-f4b8-4fe2-9ab7-49f9ceda8ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-42852bce-f4b8-4fe2-9ab7-49f9ceda8ecd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:07.234618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:07.240849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 310/610] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:07.241989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42852bce-f4b8-4fe2-9ab7-49f9ceda8ecd None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.242904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.242904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.242904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.242904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.243456 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:07.243760 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.245218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.247906 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:07.263655 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 301/611] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:07.264607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.338785 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42852bce-f4b8-4fe2-9ab7-49f9ceda8ecd None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.352824 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:07.364983 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3682e-bb95-43e4-b394-87dab2009f65 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.374035 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.374659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.375523 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.375834 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.376577 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=d8c2ac1eccaf4ffd88d49b119da41cae) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:07.376977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.378399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.392462 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 311/612] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/role_assignments?user.id=d8c2ac1eccaf4ffd88d49b119da41cae&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:07.392462 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.408452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.409163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.409319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.409539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.423234 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.424782 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:07.441995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:07.443031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:07.444807 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:07.444807 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:07.444807 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:07.444807 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 302/613] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:07.444807 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.502120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:07.528519 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684f61-84c8-4325-b4e5-006b4a2bb837 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.563568 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317635a3-8a9a-4cbd-97a9-976250136954 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.569788 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.571135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.571135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.571135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.571604 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:07.571952 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.573336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.584697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 312/614] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:07.586188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.604908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab3815-c88a-44cf-afdf-f81aa054c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.605517 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab3815-c88a-44cf-afdf-f81aa054c9cb None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.605799 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab3815-c88a-44cf-afdf-f81aa054c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.606071 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab3815-c88a-44cf-afdf-f81aa054c9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.638057 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:07.691489 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab3815-c88a-44cf-afdf-f81aa054c9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.693030 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab3815-c88a-44cf-afdf-f81aa054c9cb None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.703930 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc056a-1136-41d0-89d2-7af15329db33 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.741452 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.742358 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.742676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.742895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.743546 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:07.743875 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.745280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.746224 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:07.763753 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 313/615] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:07.763753 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.820944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 303/616] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:16:07.820944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab3815-c88a-44cf-afdf-f81aa054c9cb None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.881977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:07.884778 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc888c9d-5e07-4f18-85f9-9840515f3a8a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.922959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.923596 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.923902 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.924175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.926436 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab3815-c88a-44cf-afdf-f81aa054c9cb None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:07.934779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.936291 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:07.951481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:07.952458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:07.954728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:07.954728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:07.954728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:07.954728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 314/617] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:07.954728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:07.970341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:07.970933 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:07.971215 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:07.971746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:07.979718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:07.981363 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:07.992930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:07.993873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 304/618] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:08.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.010120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.067981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f111c-d06c-45c8-bb83-1a25bc43ee9d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.102882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.103594 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.103979 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.104317 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.105320 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ac261-b969-4ea4-acc4-13473a938986 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.116124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.117713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:08.132910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:08.134069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:08.135239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:08.135239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:08.135239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:08.136842 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 315/619] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:08.138349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.143858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.155897 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.157385 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.157861 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.158211 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.158931 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:08.159307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.160792 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.174247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 305/620] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:08.178703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.245574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.255557 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69a314-f57d-4473-82f3-df8db4677ec4 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.299948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848eb5e-1607-4897-96ff-9173fc1696d9 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.300842 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.301526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.301760 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.302032 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.302772 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:08.303064 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.304529 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.322317 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 316/621] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:08.323139 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.338592 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.339340 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.339729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.340153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.340984 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:08.341261 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.342550 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.354816 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 306/622] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:08.356057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.395929 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.440263 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3f655-f29c-48e2-811b-21f13b7cee2f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.461364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ada981-9e85-4579-8b69-8ce6a926342c None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.484527 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.485162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.485441 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.485710 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.493971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.494384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.495686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.504995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227262bb-669f-4567-8118-3257baf67bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.505917 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227262bb-669f-4567-8118-3257baf67bec None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.506489 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227262bb-669f-4567-8118-3257baf67bec None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.506962 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227262bb-669f-4567-8118-3257baf67bec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:08.509634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:08.510570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:08.511520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 317/623] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:08.512810 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.587677 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227262bb-669f-4567-8118-3257baf67bec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.589195 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227262bb-669f-4567-8118-3257baf67bec None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.623183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883a8b2-5f47-432c-bcc5-d7a26c31b899 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.646755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.660226 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.660863 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.661141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.661408 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.668766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.670687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:08.682428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:08.683300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:08.684183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:08.684183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:08.684183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:08.684183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:08.684183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:08.684183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:08.684183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:08.684183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:08.685841 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 318/624] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:08.686725 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.706852 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 307/625] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:16:08.707696 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227262bb-669f-4567-8118-3257baf67bec None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.737733 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.802938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c66d5-57ab-43e4-b59a-6d827e897c49 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.821413 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227262bb-669f-4567-8118-3257baf67bec None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.843276 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.844216 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.844557 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.844899 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.845728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:08.846040 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.847680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.862691 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:08.863594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:08.863594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:08.863884 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:08.864552 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:08.864858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:08.866301 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:08.867349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 319/626] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:08.868025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.880943 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 308/627] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:08.881763 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:08.915457 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.978120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:08.980156 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e5ef-52ca-4f17-bbfa-887554ad79f7 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:08.992518 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8e16c-6d9d-401a-953f-d0d148dbde3d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:09.017450 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.018169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.018514 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.018847 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.028713 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1a727-d6c1-436b-91c5-e15e479b265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.029380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1a727-d6c1-436b-91c5-e15e479b265d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.029541 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.029789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1a727-d6c1-436b-91c5-e15e479b265d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.030153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1a727-d6c1-436b-91c5-e15e479b265d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.031291 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:09.046088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:09.047971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:09.053823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:09.053823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:09.053823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:09.053823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 320/628] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:09.053823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.106424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1a727-d6c1-436b-91c5-e15e479b265d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.107923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1a727-d6c1-436b-91c5-e15e479b265d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.149672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:09.160658 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dbb0b-aade-429c-a851-49a86eb85fda None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:09.197002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.197703 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.198050 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.198400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.198840 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:09.199260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=2e31af0d7f814b0b86140be2c2d64f2d) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:09.199673 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.201149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.215853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 321/629] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/role_assignments?user.id=2e31af0d7f814b0b86140be2c2d64f2d&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:09.215853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.228993 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 309/630] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:16:09.236230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1a727-d6c1-436b-91c5-e15e479b265d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.338747 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de489-7f8f-4d99-994e-89142facdd88 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:09.379556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.380300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.380685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.381054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.381813 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:09.382223 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.383277 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1a727-d6c1-436b-91c5-e15e479b265d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:09.383819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.398836 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 322/631] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:09.404075 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.432897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:09.433085 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.433786 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.434008 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.434292 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.446209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.447745 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:09.467136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:09.468602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:09.469626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:09.469626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:09.469626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:09.480902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 310/632] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:09.480902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.544852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610c5a5-4072-43bb-b6e3-177461d72a02 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:09.546150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:09.589464 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.590013 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.590293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.590561 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.598996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.600685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:09.615805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:09.616819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:09.617685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 323/633] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:09.622820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.626092 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ac77-d120-42fc-b039-7d9532175f8b None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:09.673227 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa15d7-e55d-49bd-b01c-97972fd5dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.674467 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa15d7-e55d-49bd-b01c-97972fd5dc52 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.674980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa15d7-e55d-49bd-b01c-97972fd5dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.675613 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa15d7-e55d-49bd-b01c-97972fd5dc52 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.676789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa15d7-e55d-49bd-b01c-97972fd5dc52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:09.677323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa15d7-e55d-49bd-b01c-97972fd5dc52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.679318 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa15d7-e55d-49bd-b01c-97972fd5dc52 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.695964 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 311/634] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:09.697585 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737d887-32ee-4435-9efc-fc62753a4095 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.698075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737d887-32ee-4435-9efc-fc62753a4095 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.698573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737d887-32ee-4435-9efc-fc62753a4095 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.700232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 312/635] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:09.702123 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737d887-32ee-4435-9efc-fc62753a4095 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.705435 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:09.730841 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a2e7a-d21e-4188-b47b-6de804a4b8ce None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:09.770233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada83db-31c3-4d2e-a185-f1c63a8f42cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.771154 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada83db-31c3-4d2e-a185-f1c63a8f42cb None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.771592 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada83db-31c3-4d2e-a185-f1c63a8f42cb None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.771894 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada83db-31c3-4d2e-a185-f1c63a8f42cb None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.772596 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada83db-31c3-4d2e-a185-f1c63a8f42cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:09.772902 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada83db-31c3-4d2e-a185-f1c63a8f42cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.774344 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada83db-31c3-4d2e-a185-f1c63a8f42cb None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.787011 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 324/636] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:09.788075 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b81b-cd45-4513-97f7-cf8f7f68e9b3 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.788360 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b81b-cd45-4513-97f7-cf8f7f68e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.788633 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b81b-cd45-4513-97f7-cf8f7f68e9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.807393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e325b81b-cd45-4513-97f7-cf8f7f68e9b3 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:09.808710 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e325b81b-cd45-4513-97f7-cf8f7f68e9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:09.812030 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:09.819341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737d887-32ee-4435-9efc-fc62753a4095 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:09.855874 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:09.856431 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:09.856857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:09.857072 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:09.864544 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:09.866178 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:09.878698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:09.879770 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:09.880702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 313/637] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:09.881187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.886191 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 325/638] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:09.892475 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b81b-cd45-4513-97f7-cf8f7f68e9b3 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:09.989367 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:09.990179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700c901-aa36-49a0-87a3-738b357805f6 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:10.032499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:10.033122 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:10.033398 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:10.033666 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:10.034542 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=0c2c8ea12b814b0f9abaaa2a2b8cd3cb) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:10.034856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:10.036431 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:10.039708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b81b-cd45-4513-97f7-cf8f7f68e9b3 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:10.042480 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 314/639] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/role_assignments?user.id=0c2c8ea12b814b0f9abaaa2a2b8cd3cb&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:10.081210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:10.082202 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:10.082688 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:10.083164 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:10.084159 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:10.084788 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:10.086515 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:10.100489 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 326/640] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:10.109328 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:10.135552 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:10.232187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9152ee8-80fe-4937-9ce1-45c7d3903675 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:10.250392 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:10.272570 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:10.273170 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:10.273521 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:10.273796 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:10.274523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=5c0f0416eaed4d8eaa78daa33fcf06b9) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:10.274829 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:10.276309 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:10.287859 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 315/641] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:10 2022] GET /identity/v3/role_assignments?user.id=5c0f0416eaed4d8eaa78daa33fcf06b9&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:10.381697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcd29c-6d2a-4a99-8b4e-6e0194d9db25 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:10.412322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:10.423447 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706c0c6-ff4c-4357-b724-44f0621aecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:10.424129 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706c0c6-ff4c-4357-b724-44f0621aecf5 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:10.424408 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706c0c6-ff4c-4357-b724-44f0621aecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:10.424677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706c0c6-ff4c-4357-b724-44f0621aecf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:10.436915 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706c0c6-ff4c-4357-b724-44f0621aecf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-2706c0c6-ff4c-4357-b724-44f0621aecf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:10.442721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:10.443774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:10.444686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 327/642] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:10.451853 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:10.564203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:10.571262 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f643337-9256-4975-8863-49e4851f7b79 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:10.608675 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:10.609851 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:10.610132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:10.610403 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:10.611060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:10.611353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:10.612743 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:10.621891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 316/643] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:10.628207 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706c0c6-ff4c-4357-b724-44f0621aecf5 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:10.742115 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706c0c6-ff4c-4357-b724-44f0621aecf5 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:10.778076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:10.779051 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:10.779556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:10.780135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:10.791447 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:10.793199 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:10.809479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:10.810474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:10.811364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:10.811364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:10.811364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:10.813690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 328/644] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:10.820649 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:10.932701 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f625-b4a0-4653-a761-013bc3d7f8e9 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:10.968564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:10.969115 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:10.969388 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:10.969654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:10.970284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:10.970581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:10.972584 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:10.985019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 317/645] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:10.990411 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:11.034301 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:11.100782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d211743-228d-46dd-9075-5f1e36e5cf72 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:11.137096 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:11.138111 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:11.138598 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:11.139094 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:11.147675 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:11.149434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:11.161759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:11.162726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:11.163687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:11.166310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 329/646] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 00:16:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:11.172565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:11.184007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:11.281658 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538d8a8-2343-4623-860b-9f93e900202d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:11.320581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83a267-a6fe-437e-aa60-3a9b2670deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:11.321188 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83a267-a6fe-437e-aa60-3a9b2670deb7 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:11.321462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83a267-a6fe-437e-aa60-3a9b2670deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:11.321730 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83a267-a6fe-437e-aa60-3a9b2670deb7 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:11.322543 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83a267-a6fe-437e-aa60-3a9b2670deb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:11.322891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83a267-a6fe-437e-aa60-3a9b2670deb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:11.324345 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83a267-a6fe-437e-aa60-3a9b2670deb7 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:11.344969 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 318/647] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 00:16:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:11.350463 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:11.458825 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:11.462885 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148ddb5-1567-41aa-b6fc-fb7a757c9de0 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:11.500099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b3d93-8215-40c1-abbd-f5a50f12eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:11.500717 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b3d93-8215-40c1-abbd-f5a50f12eed4 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:11.500981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b3d93-8215-40c1-abbd-f5a50f12eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:11.501256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b3d93-8215-40c1-abbd-f5a50f12eed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:11.579979 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b3d93-8215-40c1-abbd-f5a50f12eed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:11.581376 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b3d93-8215-40c1-abbd-f5a50f12eed4 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:11.589306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282f634-0ab4-469e-8678-1af67ee4ce25 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:11.590318 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282f634-0ab4-469e-8678-1af67ee4ce25 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:11.590798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282f634-0ab4-469e-8678-1af67ee4ce25 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:11.592766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 319/648] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:11.599457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afec0aa-1c2c-47b0-af4e-33cf1f4e4e48 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:11.600092 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afec0aa-1c2c-47b0-af4e-33cf1f4e4e48 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:11.600599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afec0aa-1c2c-47b0-af4e-33cf1f4e4e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:11.619168 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-7afec0aa-1c2c-47b0-af4e-33cf1f4e4e48 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:11.620727 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-7afec0aa-1c2c-47b0-af4e-33cf1f4e4e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:11.684281 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:11.685331 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:11.695860 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 330/649] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:16:11.696423 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 320/650] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:16:11.696948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b3d93-8215-40c1-abbd-f5a50f12eed4 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:11.801673 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b3d93-8215-40c1-abbd-f5a50f12eed4 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:11.838934 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:11.839495 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:11.839814 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:11.840107 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:11.851049 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:11.852530 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:11.867794 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:11.868766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:11.869636 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:11.869636 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:11.869636 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:11.869636 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 331/651] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:11.874384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afec0aa-1c2c-47b0-af4e-33cf1f4e4e48 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:11.983153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afec0aa-1c2c-47b0-af4e-33cf1f4e4e48 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:12.022402 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:12.023400 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.023914 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.024391 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.025253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:12.025769 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:12.027528 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:12.040520 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 321/652] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:12.047855 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:12.051086 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:12.100355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:12.111240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:12.171631 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b2f2b-b63d-41b2-a3df-d255e383a157 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:12.188100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65880-9116-4e02-870f-279fe11b1a0d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:12.213007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:12.213625 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.213900 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.214169 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] PATH_INFO: `/v3/services/image` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.214813 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:12.216432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:12.228566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:12.229642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:12.230535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:12.234902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 322/653] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 24 00:16:12 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:12.235923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:12.237936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:12.239255 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.239807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.241416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.252449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:12.255308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:12.274261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:12.275218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:12.276231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:12.276231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:12.276231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:12.276231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:12.276231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:12.276231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:12.276231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:12.276231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:12.279399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 332/654] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:12.284919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:12.388078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22914c0-9095-4ccc-903f-ca30fba201db None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:12.412876 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:12.413677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fab0f7-0dcb-463d-8a6b-a9e5065c4f9b None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:12.425982 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:12.428340 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702c4b7-bc9f-4f2b-95aa-191978717691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:12.428982 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c4b7-bc9f-4f2b-95aa-191978717691 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.429339 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c4b7-bc9f-4f2b-95aa-191978717691 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.429618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c4b7-bc9f-4f2b-95aa-191978717691 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.430251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702c4b7-bc9f-4f2b-95aa-191978717691 None admin] RBAC: Adding query filter params (name=image) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:12.430558 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702c4b7-bc9f-4f2b-95aa-191978717691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:12.431964 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702c4b7-bc9f-4f2b-95aa-191978717691 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:12.441370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 323/655] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:12.441370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ac572-2939-4acf-9e44-2fd5647cf877 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.441370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ac572-2939-4acf-9e44-2fd5647cf877 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.441370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ac572-2939-4acf-9e44-2fd5647cf877 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.441370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 324/656] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:12.445125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ac572-2939-4acf-9e44-2fd5647cf877 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:12.457965 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984a77-368a-41eb-b5c9-9f121315334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:12.458572 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984a77-368a-41eb-b5c9-9f121315334c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.458848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984a77-368a-41eb-b5c9-9f121315334c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.459398 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984a77-368a-41eb-b5c9-9f121315334c None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.459854 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984a77-368a-41eb-b5c9-9f121315334c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:12.460119 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984a77-368a-41eb-b5c9-9f121315334c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:12.461549 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984a77-368a-41eb-b5c9-9f121315334c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:12.481676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 333/657] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:12.487859 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6331c3-ef42-4e7f-8413-cb2995629d58 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.488127 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6331c3-ef42-4e7f-8413-cb2995629d58 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.488403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6331c3-ef42-4e7f-8413-cb2995629d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.508015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-1f6331c3-ef42-4e7f-8413-cb2995629d58 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:12.509243 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-1f6331c3-ef42-4e7f-8413-cb2995629d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:12.560477 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ac572-2939-4acf-9e44-2fd5647cf877 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:12.579091 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 334/658] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:12.589001 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6331c3-ef42-4e7f-8413-cb2995629d58 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:12.598886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e320c7-6f97-4c10-b32c-22abead27a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:12.600199 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e320c7-6f97-4c10-b32c-22abead27a9b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.600623 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e320c7-6f97-4c10-b32c-22abead27a9b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.601069 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e320c7-6f97-4c10-b32c-22abead27a9b None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.601969 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e320c7-6f97-4c10-b32c-22abead27a9b None admin] RBAC: Adding query filter params (type=image) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:12.602428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e320c7-6f97-4c10-b32c-22abead27a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:12.604224 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e320c7-6f97-4c10-b32c-22abead27a9b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:12.620350 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 325/659] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:12.708366 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:12.711613 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6331c3-ef42-4e7f-8413-cb2995629d58 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:12.751516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cad7b9-b360-4f15-a0d5-49db83a8b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:12.752234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad7b9-b360-4f15-a0d5-49db83a8b38d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.752512 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad7b9-b360-4f15-a0d5-49db83a8b38d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.752778 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad7b9-b360-4f15-a0d5-49db83a8b38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.753515 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cad7b9-b360-4f15-a0d5-49db83a8b38d None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=d8c2ac1eccaf4ffd88d49b119da41cae) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:12.753819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cad7b9-b360-4f15-a0d5-49db83a8b38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:12.755326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cad7b9-b360-4f15-a0d5-49db83a8b38d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:12.762133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 335/660] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:12 2022] GET /identity/v3/role_assignments?user.id=d8c2ac1eccaf4ffd88d49b119da41cae&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=952eea31fada4104858d315ac0f1296a => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:12.783413 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6c3d-af4e-4f8b-8275-a2e582628424 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.783778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6c3d-af4e-4f8b-8275-a2e582628424 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.784036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6c3d-af4e-4f8b-8275-a2e582628424 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.785793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 326/661] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:12.791813 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a82d-2f16-417f-b49b-0410df6cf607 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:12.792187 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a82d-2f16-417f-b49b-0410df6cf607 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:12.792448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a82d-2f16-417f-b49b-0410df6cf607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:12.813676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-5794a82d-2f16-417f-b49b-0410df6cf607 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:12.814894 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-5794a82d-2f16-417f-b49b-0410df6cf607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:12.892960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 336/662] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:12.916722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d6c3d-af4e-4f8b-8275-a2e582628424 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:12.976423 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:13.034437 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d6c3d-af4e-4f8b-8275-a2e582628424 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:13.076698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:13.077322 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:13.077661 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:13.077932 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] PATH_INFO: `/v3/services/network` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:13.078517 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:13.079909 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:13.088700 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:13.089662 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:13.090483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:13.095215 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 327/663] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:12 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:13.096611 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794a82d-2f16-417f-b49b-0410df6cf607 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:13.199318 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:13.206188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794a82d-2f16-417f-b49b-0410df6cf607 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:13.225058 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:13.242039 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:13.242566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:13.242839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:13.243105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:13.243724 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] RBAC: Adding query filter params (name=network) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:13.244119 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:13.245481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:13.251046 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 337/664] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:13.257009 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:13.357759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46d036-d196-4a79-95ed-f10188f6c45e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:13.378181 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:13.378832 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b6b17-3844-46c3-8c03-4f59a22db44a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:13.412556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:13.413677 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:13.414113 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:13.414932 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:13.415966 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:13.417879 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:13.419768 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:13.420544 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:13.420859 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:13.421767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:13.422483 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] RBAC: Adding query filter params (type=network) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:13.423070 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:13.424422 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:13.430768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:13.431868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:13.432703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:13.433415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 338/665] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:13.433487 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 328/666] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 24 00:16:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:13.440403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:13.470513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:13.561645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fe59d-f772-4a5d-bb82-afbe8a20af9d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:13.602963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b64c97-da37-42b4-96ff-6e53a1e17a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:13.603628 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b64c97-da37-42b4-96ff-6e53a1e17a98 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:13.603941 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b64c97-da37-42b4-96ff-6e53a1e17a98 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:13.604219 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b64c97-da37-42b4-96ff-6e53a1e17a98 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:13.604855 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b64c97-da37-42b4-96ff-6e53a1e17a98 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:13.605160 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b64c97-da37-42b4-96ff-6e53a1e17a98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:13.606617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b64c97-da37-42b4-96ff-6e53a1e17a98 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:13.612777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 339/667] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 00:16:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:13.618553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:13.729604 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834669b-e30b-46eb-ad7b-1692c330bec8 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:13.772060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a065aa3-2c24-461c-8502-acd9a1958ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:13.772821 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a065aa3-2c24-461c-8502-acd9a1958ba6 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:13.773108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a065aa3-2c24-461c-8502-acd9a1958ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:13.773446 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a065aa3-2c24-461c-8502-acd9a1958ba6 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:13.774204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a065aa3-2c24-461c-8502-acd9a1958ba6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:13.774517 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a065aa3-2c24-461c-8502-acd9a1958ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:13.775913 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a065aa3-2c24-461c-8502-acd9a1958ba6 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:13.781512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 329/668] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 00:16:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:14.940777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6422-7c72-4c63-b91d-dd40ecac1283 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:14.941316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6422-7c72-4c63-b91d-dd40ecac1283 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:14.941316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6422-7c72-4c63-b91d-dd40ecac1283 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:14.943108 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 340/669] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:14.948999 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9392-b76b-4ee9-a14b-5ed0e7917576 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:14.949490 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9392-b76b-4ee9-a14b-5ed0e7917576 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:14.949570 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9392-b76b-4ee9-a14b-5ed0e7917576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:14.968959 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-d4fe9392-b76b-4ee9-a14b-5ed0e7917576 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:14.970144 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-d4fe9392-b76b-4ee9-a14b-5ed0e7917576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:15.007634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:15.044474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca902d5-d98e-423f-86bf-5dbc8f0f39d6 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:15.044755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca902d5-d98e-423f-86bf-5dbc8f0f39d6 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:15.045030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca902d5-d98e-423f-86bf-5dbc8f0f39d6 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:15.045871 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 330/670] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:15.047183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 341/671] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:15.055848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755251a7-4015-455b-bf25-378adb6eeac5 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:15.055848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755251a7-4015-455b-bf25-378adb6eeac5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:15.055848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755251a7-4015-455b-bf25-378adb6eeac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:15.071302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-755251a7-4015-455b-bf25-378adb6eeac5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:15.072509 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-755251a7-4015-455b-bf25-378adb6eeac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:15.141447 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 342/672] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:16:15.371504 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe9392-b76b-4ee9-a14b-5ed0e7917576 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:15.473050 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755251a7-4015-455b-bf25-378adb6eeac5 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:15.484370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe9392-b76b-4ee9-a14b-5ed0e7917576 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:15.498593 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:15.522416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe91a1-418c-4aa4-9874-c1ba69da5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:15.523114 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe91a1-418c-4aa4-9874-c1ba69da5e07 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:15.523389 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe91a1-418c-4aa4-9874-c1ba69da5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:15.523657 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe91a1-418c-4aa4-9874-c1ba69da5e07 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:15.524944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe91a1-418c-4aa4-9874-c1ba69da5e07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:15.525780 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe91a1-418c-4aa4-9874-c1ba69da5e07 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:15.546154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 331/673] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:16:15 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:15.607004 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755251a7-4015-455b-bf25-378adb6eeac5 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:15.656377 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc206a41-c778-455d-a2e9-d6d284c69352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:15.657484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc206a41-c778-455d-a2e9-d6d284c69352 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:15.657972 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc206a41-c778-455d-a2e9-d6d284c69352 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:15.658482 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc206a41-c778-455d-a2e9-d6d284c69352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:15.673928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc206a41-c778-455d-a2e9-d6d284c69352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-fc206a41-c778-455d-a2e9-d6d284c69352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:15.679424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:15.680492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:15.681336 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:15.684253 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 343/674] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:16:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:15.693110 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe91a1-418c-4aa4-9874-c1ba69da5e07 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:15.728938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:15.816025 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe91a1-418c-4aa4-9874-c1ba69da5e07 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:15.836527 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c1fe6-ef69-4836-9c31-8c5b5a8888ee None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:15.836874 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c1fe6-ef69-4836-9c31-8c5b5a8888ee None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:15.837082 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c1fe6-ef69-4836-9c31-8c5b5a8888ee None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:15.838535 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 344/675] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:15.843800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206a485-4239-497c-8f93-c7d111768b6b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:15.844129 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206a485-4239-497c-8f93-c7d111768b6b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:15.844412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206a485-4239-497c-8f93-c7d111768b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:15.853381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:15.854199 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:15.854621 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:15.855055 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:15.855950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:15.856389 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:15.857900 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:15.863399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-a206a485-4239-497c-8f93-c7d111768b6b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:15.864628 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-a206a485-4239-497c-8f93-c7d111768b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:15.868731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 332/676] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:15.873828 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:15.944037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 345/677] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:15 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:16:15.981574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:15.991141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838686-cfb0-46c7-8134-8d8de97fcfdd None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:16.028044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f29d5-e5b3-4fe1-a20b-75a962ffadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:16.028672 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f29d5-e5b3-4fe1-a20b-75a962ffadf0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.028949 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f29d5-e5b3-4fe1-a20b-75a962ffadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.029224 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f29d5-e5b3-4fe1-a20b-75a962ffadf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.041222 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f29d5-e5b3-4fe1-a20b-75a962ffadf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:16.042726 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f29d5-e5b3-4fe1-a20b-75a962ffadf0 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-f06f29d5-e5b3-4fe1-a20b-75a962ffadf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:16.058795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:16.059729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:16.060616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:16.060616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:16.060616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:16.060616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 333/678] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:16.066722 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206a485-4239-497c-8f93-c7d111768b6b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:16.070832 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:16.101162 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291ac0-b533-40fe-abcb-4d42f112e5bd None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.101483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291ac0-b533-40fe-abcb-4d42f112e5bd None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.101726 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291ac0-b533-40fe-abcb-4d42f112e5bd None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.103497 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 334/679] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:16.108607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c761-c3d9-48da-b22f-fd4494f75b7a None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.109021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c761-c3d9-48da-b22f-fd4494f75b7a None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.109304 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c761-c3d9-48da-b22f-fd4494f75b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.129399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-a980c761-c3d9-48da-b22f-fd4494f75b7a None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:16.130695 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-a980c761-c3d9-48da-b22f-fd4494f75b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:16.191424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206a485-4239-497c-8f93-c7d111768b6b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:16.220472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 335/680] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:16 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:16:16.235934 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:16.236544 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.236822 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.237093 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.237731 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:16.238029 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:16.239450 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:16.253069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 346/681] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:16.258322 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980c761-c3d9-48da-b22f-fd4494f75b7a None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:16.292771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:16.349755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:16.387708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:16.401819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980c761-c3d9-48da-b22f-fd4494f75b7a None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:16.436594 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387e36-1e57-4fac-8302-1dbd23911d1a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:16.437804 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:16.438447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.438728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.439003 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.446416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:16.447917 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:16.460634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:16.461645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:16.462572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:16.466227 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 336/682] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 00:16:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:16.467504 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:16.492762 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c4af-9a16-47ce-8a81-b317ae5d1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:16.493576 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c4af-9a16-47ce-8a81-b317ae5d1371 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.493999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c4af-9a16-47ce-8a81-b317ae5d1371 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.494463 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c4af-9a16-47ce-8a81-b317ae5d1371 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.495778 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c4af-9a16-47ce-8a81-b317ae5d1371 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:16.497601 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c4af-9a16-47ce-8a81-b317ae5d1371 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:16.520174 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 347/683] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:16:16 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:16:16.554068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c4af-9a16-47ce-8a81-b317ae5d1371 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:16.603474 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a1d8-bada-4473-9507-2d0173109169 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:16.646331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:16.662029 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:16.663154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.663738 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.664352 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.665395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:16.666078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:16.668146 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:16.691618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 337/684] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 00:16:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:16.693752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c4af-9a16-47ce-8a81-b317ae5d1371 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:16.697157 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:16.723645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:16.744623 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad87e-aba8-449a-8723-5c05cff9de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:16.745161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad87e-aba8-449a-8723-5c05cff9de11 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.745443 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad87e-aba8-449a-8723-5c05cff9de11 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.745713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad87e-aba8-449a-8723-5c05cff9de11 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.746807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad87e-aba8-449a-8723-5c05cff9de11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:16.748697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad87e-aba8-449a-8723-5c05cff9de11 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:16.771893 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 348/685] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:16:16 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:16:16.827179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab53ed-190b-4b69-9732-0e4186e9b81a None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:16.874859 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:16.875494 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:16.875769 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:16.876073 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:16.888160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:16.889747 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:16.906582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:16.907606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:16.908523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:16.908523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:16.908523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:16.908523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 338/686] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:16.913949 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad87e-aba8-449a-8723-5c05cff9de11 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:17.030203 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad87e-aba8-449a-8723-5c05cff9de11 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:17.068314 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:17.068927 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:17.069207 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:17.069483 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:17.070126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:17.070429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:17.071797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:17.090248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 349/687] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:17.093845 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:17.151544 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:17.267196 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c652d6a-fe10-46ad-9ae7-6e64e04e2b07 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:17.302984 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:17.303607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:17.303905 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:17.304181 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:17.311452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:17.313788 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:17.325616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:17.326512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:17.327462 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 339/688] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:17.332839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:17.379354 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:17.442236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4e3b9-7bf4-4b39-b642-4c347e732d0a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:17.478430 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f32516-0b7c-45d3-863d-ba38b500b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:17.479043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f32516-0b7c-45d3-863d-ba38b500b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:17.479320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f32516-0b7c-45d3-863d-ba38b500b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:17.479591 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f32516-0b7c-45d3-863d-ba38b500b7d8 None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:17.480306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f32516-0b7c-45d3-863d-ba38b500b7d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:17.480609 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f32516-0b7c-45d3-863d-ba38b500b7d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:17.482161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f32516-0b7c-45d3-863d-ba38b500b7d8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:17.499734 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 350/689] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:17.501279 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:17.607545 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:17.613912 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da2125-7618-4e33-9bd7-7f7e0fd4dbd0 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:17.650014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef414df-16b6-4929-9606-ad4d0aa2cad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:17.650656 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef414df-16b6-4929-9606-ad4d0aa2cad5 None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:17.650931 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef414df-16b6-4929-9606-ad4d0aa2cad5 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:17.651202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef414df-16b6-4929-9606-ad4d0aa2cad5 None admin] PATH_INFO: `/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/d8c2ac1eccaf4ffd88d49b119da41cae/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:17.653140 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef414df-16b6-4929-9606-ad4d0aa2cad5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ee46bb5a5b04e239bf1ef96355c8080, user_id=d8c2ac1eccaf4ffd88d49b119da41cae, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:17.654562 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef414df-16b6-4929-9606-ad4d0aa2cad5 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:17.671427 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 340/690] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:16:17 2022] PUT /identity/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/d8c2ac1eccaf4ffd88d49b119da41cae/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:16:18.043560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a42ab-4f1b-4606-98f0-90feec211a17 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:18.044852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a42ab-4f1b-4606-98f0-90feec211a17 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:18.045345 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a42ab-4f1b-4606-98f0-90feec211a17 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:18.047872 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 351/691] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:18.053378 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429804d-e8e5-4855-b618-866bbecf1f4e None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:18.053903 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429804d-e8e5-4855-b618-866bbecf1f4e None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:18.054399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429804d-e8e5-4855-b618-866bbecf1f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:18.073048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-d429804d-e8e5-4855-b618-866bbecf1f4e None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:18.074612 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-d429804d-e8e5-4855-b618-866bbecf1f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:18.149575 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 341/692] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:18.492431 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a42ab-4f1b-4606-98f0-90feec211a17 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:18.599278 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a42ab-4f1b-4606-98f0-90feec211a17 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:18.601609 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:18.636945 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:18.637956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:18.638442 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:18.638931 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] PATH_INFO: `/v3/services/image` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:18.640395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:18.641977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:18.653038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:18.653996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:18.654828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:18.657636 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 352/693] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 24 00:16:18 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:18.663647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429804d-e8e5-4855-b618-866bbecf1f4e None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:18.755152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:18.771335 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429804d-e8e5-4855-b618-866bbecf1f4e None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:18.807575 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d3b37-8449-4a3d-82f1-8d9056d43c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:18.808214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3b37-8449-4a3d-82f1-8d9056d43c5a None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:18.808491 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3b37-8449-4a3d-82f1-8d9056d43c5a None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:18.808761 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3b37-8449-4a3d-82f1-8d9056d43c5a None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:18.809394 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d3b37-8449-4a3d-82f1-8d9056d43c5a None admin] RBAC: Adding query filter params (name=image) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:18.809693 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d3b37-8449-4a3d-82f1-8d9056d43c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:18.811077 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d3b37-8449-4a3d-82f1-8d9056d43c5a None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:18.817308 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 342/694] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:18.825461 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:18.944905 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537670-d3a1-46a9-bd08-ad83607c1ba9 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:18.980403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:18.981013 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:18.981292 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:18.981566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:18.982200 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] RBAC: Adding query filter params (type=image) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:18.982506 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:18.987616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:18.991386 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc6ba-aa91-493e-b6d8-6ce59fd4aa7f None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:18.991683 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc6ba-aa91-493e-b6d8-6ce59fd4aa7f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:18.991995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc6ba-aa91-493e-b6d8-6ce59fd4aa7f None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:18.993547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 343/695] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:18.994204 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 353/696] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:18.999627 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c56410-c348-4acc-bc2b-88ded2c13cb5 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:18.999996 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c56410-c348-4acc-bc2b-88ded2c13cb5 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.000296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c56410-c348-4acc-bc2b-88ded2c13cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.002151 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:19.019477 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f8c56410-c348-4acc-bc2b-88ded2c13cb5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:19.020623 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f8c56410-c348-4acc-bc2b-88ded2c13cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:19.035588 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:19.100137 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 344/697] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:19.115665 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b6c57-fa1f-4283-a370-b0caa7fb287d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:19.150272 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab540c-a233-4d56-9e14-a6272f70f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:19.150884 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab540c-a233-4d56-9e14-a6272f70f15f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:19.151162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab540c-a233-4d56-9e14-a6272f70f15f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.151431 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab540c-a233-4d56-9e14-a6272f70f15f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.152212 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab540c-a233-4d56-9e14-a6272f70f15f None admin] RBAC: Adding query filter params (interface=public, service_id=e9e471f24bb24348b46788a45ac1456d, region_id=RegionOne) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:19.152519 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab540c-a233-4d56-9e14-a6272f70f15f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:19.153926 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab540c-a233-4d56-9e14-a6272f70f15f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:19.162507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 354/698] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 00:16:19 2022] GET /identity/v3/endpoints?service_id=e9e471f24bb24348b46788a45ac1456d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:19.167863 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c56410-c348-4acc-bc2b-88ded2c13cb5 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:19.246867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d14581-17d9-4588-b6b6-5b046bf31f2e None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:19.247187 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d14581-17d9-4588-b6b6-5b046bf31f2e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.247425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d14581-17d9-4588-b6b6-5b046bf31f2e None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.250597 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 355/699] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:19.252581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:19.255022 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6039f7-e200-48da-9a41-db988d91e185 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:19.255304 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6039f7-e200-48da-9a41-db988d91e185 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.255581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6039f7-e200-48da-9a41-db988d91e185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.273036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c56410-c348-4acc-bc2b-88ded2c13cb5 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:19.274929 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-4e6039f7-e200-48da-9a41-db988d91e185 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:19.276243 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-4e6039f7-e200-48da-9a41-db988d91e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:19.309411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eadb0c-a14c-4531-a728-12494230b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:19.310012 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eadb0c-a14c-4531-a728-12494230b55f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:19.310302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eadb0c-a14c-4531-a728-12494230b55f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.310555 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eadb0c-a14c-4531-a728-12494230b55f None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.311230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eadb0c-a14c-4531-a728-12494230b55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:19.313840 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eadb0c-a14c-4531-a728-12494230b55f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:19.319743 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 345/700] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 00:16:19 2022] GET /identity/v3/services => generated 1002 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:16:19.367977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 356/701] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:19.458873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eadb0c-a14c-4531-a728-12494230b55f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:19.578271 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eadb0c-a14c-4531-a728-12494230b55f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:19.613719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:19.614344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:19.614618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.614943 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] PATH_INFO: `/v3/services/network` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.615518 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:19.617008 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:19.627174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:19.628231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:19.629064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 346/702] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:19 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:19.634597 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6039f7-e200-48da-9a41-db988d91e185 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:19.665892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:19.704280 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:19.715965 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:19.754531 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6039f7-e200-48da-9a41-db988d91e185 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:19.792299 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:19.792935 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:19.793214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.793488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.794381 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:19.794682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:19.796833 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:19.807441 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 357/703] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:19.808669 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:19.829045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3830c-8d3d-4b21-a90f-59b7a9986500 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:19.867277 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:19.868129 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:19.868263 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.868506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.869140 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:19.870891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:19.882468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:19.883501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:19.884447 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 347/704] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 24 00:16:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:19.891140 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:19.934689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:19.948917 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674fd9d-81a0-4575-8198-99d0f50620e9 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:19.969343 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:19.986721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad333dd-e104-4fff-9c1a-109ab1eb45cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:19.987565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad333dd-e104-4fff-9c1a-109ab1eb45cb None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:19.988029 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad333dd-e104-4fff-9c1a-109ab1eb45cb None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:19.988459 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad333dd-e104-4fff-9c1a-109ab1eb45cb None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:19.989218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad333dd-e104-4fff-9c1a-109ab1eb45cb None admin] RBAC: Adding query filter params (type=network) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:19.989668 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad333dd-e104-4fff-9c1a-109ab1eb45cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:19.991450 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad333dd-e104-4fff-9c1a-109ab1eb45cb None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:20.001570 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 358/705] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:20.003307 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b1fe-7a62-49b2-a649-74233b1434c4 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.003478 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b14e-2fa0-48ef-b880-0fa208764f38 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:20.003965 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b1fe-7a62-49b2-a649-74233b1434c4 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.004342 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b1fe-7a62-49b2-a649-74233b1434c4 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.005837 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 359/706] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:20.008683 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b1fe-7a62-49b2-a649-74233b1434c4 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:20.043096 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7ffcf-3f4e-4691-b378-269322ef7cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:20.044347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ffcf-3f4e-4691-b378-269322ef7cb4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.044835 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ffcf-3f4e-4691-b378-269322ef7cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.045312 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ffcf-3f4e-4691-b378-269322ef7cb4 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.046377 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7ffcf-3f4e-4691-b378-269322ef7cb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:20.046891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7ffcf-3f4e-4691-b378-269322ef7cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:20.048478 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7ffcf-3f4e-4691-b378-269322ef7cb4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:20.053531 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 348/707] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 00:16:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:20.054577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9780-20c8-4403-bc58-472c65145423 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.054864 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9780-20c8-4403-bc58-472c65145423 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.055140 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9780-20c8-4403-bc58-472c65145423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.076139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-136f9780-20c8-4403-bc58-472c65145423 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:20.077956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-136f9780-20c8-4403-bc58-472c65145423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:20.120786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b1fe-7a62-49b2-a649-74233b1434c4 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:20.156355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:20.156954 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.157234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.157506 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.158197 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] RBAC: Adding query filter params (interface=public, service_id=f29b1abe080944dfbeebf6afbce8a563, region_id=RegionOne) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:20.158504 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:20.159884 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:20.160562 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 349/708] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:20.161616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f9780-20c8-4403-bc58-472c65145423 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:20.169775 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 360/709] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 00:16:20 2022] GET /identity/v3/endpoints?service_id=f29b1abe080944dfbeebf6afbce8a563&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:20.170556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:20.189805 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:20.252349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:20.280257 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c53a8-ee70-4acf-b61a-06722955152b None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:20.299033 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f9780-20c8-4403-bc58-472c65145423 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:20.319034 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8a7f-03a9-40e2-995b-b90519b01383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:20.319814 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8a7f-03a9-40e2-995b-b90519b01383 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.320239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8a7f-03a9-40e2-995b-b90519b01383 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.320582 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8a7f-03a9-40e2-995b-b90519b01383 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.321409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa8a7f-03a9-40e2-995b-b90519b01383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:20.322955 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa8a7f-03a9-40e2-995b-b90519b01383 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:20.329580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 361/710] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 00:16:20 2022] GET /identity/v3/services => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:16:20.341666 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:20.342616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.343340 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.343860 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.344712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:20.345208 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:20.346803 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:20.353223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 350/711] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 00:16:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:20.361412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8a7f-03a9-40e2-995b-b90519b01383 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:20.467591 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:20.489647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8a7f-03a9-40e2-995b-b90519b01383 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:20.501489 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:20.621129 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4288-5548-4572-95a6-26a65d51e660 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:20.652786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:20.653384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.653498 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:20.653676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.653916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.654607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] RBAC: Adding query filter params (interface=public, service_id=fa6ce2defde74bb9970e7d434d2cfc7f, region_id=RegionOne) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:20.654910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:20.657166 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:20.661621 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5f53d-b79b-40b0-b4c7-cc5c88fd5cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:20.662318 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f53d-b79b-40b0-b4c7-cc5c88fd5cba None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.662602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f53d-b79b-40b0-b4c7-cc5c88fd5cba None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.662759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 362/712] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 00:16:20 2022] GET /identity/v3/endpoints?service_id=fa6ce2defde74bb9970e7d434d2cfc7f&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:20.662864 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f53d-b79b-40b0-b4c7-cc5c88fd5cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.668476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:20.674722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5f53d-b79b-40b0-b4c7-cc5c88fd5cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-88e5f53d-b79b-40b0-b4c7-cc5c88fd5cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:20.679637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:20.680800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:20.681702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 351/713] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:20.687452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5f53d-b79b-40b0-b4c7-cc5c88fd5cba None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:20.791734 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418c8eb-ff6b-4b0c-badb-c90a624cee74 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:20.799213 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5f53d-b79b-40b0-b4c7-cc5c88fd5cba None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:20.836419 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09375c-6548-43cb-92c6-4b7aa3b8a58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:20.837032 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09375c-6548-43cb-92c6-4b7aa3b8a58a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.838302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09375c-6548-43cb-92c6-4b7aa3b8a58a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.838580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09375c-6548-43cb-92c6-4b7aa3b8a58a None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.839186 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09375c-6548-43cb-92c6-4b7aa3b8a58a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:20.840639 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09375c-6548-43cb-92c6-4b7aa3b8a58a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:20.841909 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:20.843078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:20.843555 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:20.844316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:20.845177 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:20.845672 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:20.846697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 363/714] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 00:16:20 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:16:20.847444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:20.857189 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 352/715] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:20.863936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09375c-6548-43cb-92c6-4b7aa3b8a58a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:20.878188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:20.989520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09375c-6548-43cb-92c6-4b7aa3b8a58a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:21.029662 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:21.030799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.031501 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.032010 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.044416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:21.046624 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:21.064364 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:21.065583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:21.066673 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:21.066673 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:21.066673 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:21.068412 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 364/716] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:21.074264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:21.131163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:21.186885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c81d2e-f5da-47b0-9984-a961cefd9889 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:21.222146 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:21.222748 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.223025 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.223296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.223965 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:21.224268 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:21.225640 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:21.239152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 353/717] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:21.244621 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:21.312748 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:21.359102 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d71cea-5044-4022-bc76-c5195db72184 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:21.397169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:21.397803 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.398082 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.398355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.406685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:21.408163 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:21.420466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:21.422882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:21.424047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 365/718] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 00:16:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:21.428121 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:21.542602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994f4fd-0c98-4e63-9f1c-898fe60f8560 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:21.560218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:21.583767 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029bf82-ccf1-4ae6-ace9-44d6b0117017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:21.584320 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029bf82-ccf1-4ae6-ace9-44d6b0117017 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.584600 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029bf82-ccf1-4ae6-ace9-44d6b0117017 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.584872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029bf82-ccf1-4ae6-ace9-44d6b0117017 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.585609 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029bf82-ccf1-4ae6-ace9-44d6b0117017 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:21.585906 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029bf82-ccf1-4ae6-ace9-44d6b0117017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:21.587348 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029bf82-ccf1-4ae6-ace9-44d6b0117017 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:21.605590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 354/719] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 00:16:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:21.611503 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:21.725646 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4b964-d733-405a-88bf-8fedd6a47c97 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:21.738368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58b0bc-76c7-4542-9ff4-1a41c0f0a214 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.738659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58b0bc-76c7-4542-9ff4-1a41c0f0a214 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.738931 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58b0bc-76c7-4542-9ff4-1a41c0f0a214 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.740548 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 355/720] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:21.746167 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e1e8a-b20a-4f55-9579-893aa2b357a0 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.746554 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e1e8a-b20a-4f55-9579-893aa2b357a0 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.746933 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e1e8a-b20a-4f55-9579-893aa2b357a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.747356 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:21.762756 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4bb11-7018-4fba-be2b-b362a58c4803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:21.763417 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4bb11-7018-4fba-be2b-b362a58c4803 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.763691 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4bb11-7018-4fba-be2b-b362a58c4803 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.763999 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4bb11-7018-4fba-be2b-b362a58c4803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.770212 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-273e1e8a-b20a-4f55-9579-893aa2b357a0 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:21.771657 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-273e1e8a-b20a-4f55-9579-893aa2b357a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:21.836767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4bb11-7018-4fba-be2b-b362a58c4803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:21.838137 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4bb11-7018-4fba-be2b-b362a58c4803 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:21.852242 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 356/721] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:16:21.941291 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 366/722] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:21 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:16:21.947079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e1e8a-b20a-4f55-9579-893aa2b357a0 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.062453 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:22.068372 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e1e8a-b20a-4f55-9579-893aa2b357a0 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.104991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.105538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.105817 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.106090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.117391 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.118838 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:22.133617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:22.134607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:22.135476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:22.135476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:22.135476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:22.135476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 357/723] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:22.143432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4bb11-7018-4fba-be2b-b362a58c4803 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.166317 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:22.209046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.248705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4bb11-7018-4fba-be2b-b362a58c4803 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.286163 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.287149 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.287634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.288161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.289007 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:22.289511 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.291079 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.308225 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 367/724] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:22.310012 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.318930 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08917e15-4a6a-4cf9-ae7f-a34f72ba642d None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.356532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.357242 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.357585 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.357862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] PATH_INFO: `/v3/services/image` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.359159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.365506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:22.377010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:22.378019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:16:22.378843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:22.383043 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 358/725] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 24 00:16:22 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:22.384297 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.407955 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:22.414640 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:22.441546 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b2cd5-c615-4077-b75d-04a0d8366f26 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.487101 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.488183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.488670 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.489241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.496992 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.499492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.509165 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3fc5-6100-4b3d-b206-d96b2796912e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:22.513087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:22.513984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:22.515638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:22.515638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:22.515638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:22.515638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:22.515638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:22.515638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:22.515638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:22.515638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:22.522970 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 368/726] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:22.524254 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.546742 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.547310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.547590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.547885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.548524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:22.548807 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.550336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.555372 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 359/727] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:22.560728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.645445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc61d-fb85-4f65-b558-cef75b5e2a82 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.648074 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:22.669889 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c0d3-68f9-433a-933d-d539c665e4a5 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.688372 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.689442 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.689954 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.690430 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.691346 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:22.691980 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.693618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.705823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:22.706194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.707004 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.707118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.707323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.708015 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] RBAC: Adding query filter params (type=image) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:22.708344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.709729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.718611 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 369/728] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:22.719890 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.720217 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 360/729] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:22.721611 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.826512 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37578348-aaad-460d-b32c-2efaa023fb54 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.833573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f94824-6c56-4404-9446-215996dcb51e None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.865521 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9869dc-acc3-47b8-95b2-0533b95d2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.866136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9869dc-acc3-47b8-95b2-0533b95d2983 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.866416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9869dc-acc3-47b8-95b2-0533b95d2983 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.866692 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9869dc-acc3-47b8-95b2-0533b95d2983 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.867353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9869dc-acc3-47b8-95b2-0533b95d2983 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.868750 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9869dc-acc3-47b8-95b2-0533b95d2983 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.869603 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd05749-3fad-4c76-a6ef-1ab5a3f64079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.870198 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd05749-3fad-4c76-a6ef-1ab5a3f64079 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.870468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd05749-3fad-4c76-a6ef-1ab5a3f64079 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.870732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd05749-3fad-4c76-a6ef-1ab5a3f64079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.871441 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd05749-3fad-4c76-a6ef-1ab5a3f64079 None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=d8c2ac1eccaf4ffd88d49b119da41cae) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:22.871740 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd05749-3fad-4c76-a6ef-1ab5a3f64079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.873161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd05749-3fad-4c76-a6ef-1ab5a3f64079 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.887379 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 370/730] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:22 2022] GET /identity/v3/role_assignments?user.id=d8c2ac1eccaf4ffd88d49b119da41cae&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=952eea31fada4104858d315ac0f1296a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:22.887379 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ed7f7-90c2-48b7-9861-00d06ec9bef0 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.887379 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ed7f7-90c2-48b7-9861-00d06ec9bef0 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.887379 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ed7f7-90c2-48b7-9861-00d06ec9bef0 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.887379 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 371/731] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:22.888867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1505-f2d0-46fb-9b8b-a7d0b630cef7 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.889166 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1505-f2d0-46fb-9b8b-a7d0b630cef7 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.890124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1505-f2d0-46fb-9b8b-a7d0b630cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.897334 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:22.904686 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 361/732] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:16:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:16:22.913799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-a0bd1505-f2d0-46fb-9b8b-a7d0b630cef7 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:22.915047 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-a0bd1505-f2d0-46fb-9b8b-a7d0b630cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:23.008067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:23.031997 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 372/733] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:22 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:16:23.165418 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803679e-7414-4faa-98b4-e7ca01c607ea None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:23.165610 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803679e-7414-4faa-98b4-e7ca01c607ea None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:23.165885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803679e-7414-4faa-98b4-e7ca01c607ea None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:23.167371 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 362/734] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:23.173611 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41177d5-05f2-4caa-8ebf-f81b7790923f None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:23.173901 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41177d5-05f2-4caa-8ebf-f81b7790923f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:23.174177 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41177d5-05f2-4caa-8ebf-f81b7790923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:23.193242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-d41177d5-05f2-4caa-8ebf-f81b7790923f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:23.194434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-d41177d5-05f2-4caa-8ebf-f81b7790923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:23.266345 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 373/735] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:23 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:16:23.376644 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803679e-7414-4faa-98b4-e7ca01c607ea None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:23.495701 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803679e-7414-4faa-98b4-e7ca01c607ea None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:23.535762 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:23.536412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:23.536731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:23.537077 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] PATH_INFO: `/v3/services/network` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:23.537680 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:23.539037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:23.549090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:23.550044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:16:23.550847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:23.554501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 363/736] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:23 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:23.556660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41177d5-05f2-4caa-8ebf-f81b7790923f None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:23.634915 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:23.671464 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41177d5-05f2-4caa-8ebf-f81b7790923f None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:23.699674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:23.716346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:23.717813 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:23.718992 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:23.719484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:23.720040 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:23.720898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] RBAC: Adding query filter params (name=network) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:23.721422 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:23.723005 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:23.729979 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 374/737] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:23.740979 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:23.776364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391781b4-aa52-4052-b921-6203f151ad45 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:23.815047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:23.815764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:23.816128 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:23.816485 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:23.817184 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:23.819533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:23.837223 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:23.838273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:23.844538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 364/738] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 24 00:16:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:23.845382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:23.863694 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f8041-0454-4b6d-8229-29793fdcdbce None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:23.908610 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:23.909234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:23.909516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:23.909789 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:23.910693 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:23.911003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:23.912566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:23.924659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 375/739] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:23.926285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:23.969078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061615d-79c5-440f-95f0-b0fee6b60a9e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:23.983808 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:24.006956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:24.016149 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:24.016757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:24.017037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:24.017314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:24.017947 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:24.018250 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:24.019771 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:24.029409 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 365/740] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 00:16:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:24.030811 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:24.056331 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18186bb-a5fd-427c-9991-5758c92c98a4 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:24.096871 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677a112-d1c8-494f-8f22-d97ee00d8179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:24.097488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677a112-d1c8-494f-8f22-d97ee00d8179 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:24.097818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677a112-d1c8-494f-8f22-d97ee00d8179 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:24.098034 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677a112-d1c8-494f-8f22-d97ee00d8179 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:24.098708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677a112-d1c8-494f-8f22-d97ee00d8179 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:24.100394 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677a112-d1c8-494f-8f22-d97ee00d8179 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:24.139898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 376/741] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:16:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:24.158460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e17653-d726-48bf-b2d8-a59338c69009 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:24.209200 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da3c9f-1d74-43d2-885e-d40f8bbd7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:24.209870 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3c9f-1d74-43d2-885e-d40f8bbd7b11 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:24.210156 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3c9f-1d74-43d2-885e-d40f8bbd7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:24.210432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3c9f-1d74-43d2-885e-d40f8bbd7b11 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:24.211166 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da3c9f-1d74-43d2-885e-d40f8bbd7b11 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:24.211476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da3c9f-1d74-43d2-885e-d40f8bbd7b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:24.212973 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da3c9f-1d74-43d2-885e-d40f8bbd7b11 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:24.219550 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 366/742] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 00:16:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:24.225694 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677a112-d1c8-494f-8f22-d97ee00d8179 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:24.342988 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677a112-d1c8-494f-8f22-d97ee00d8179 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:24.345516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:24.387590 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a32f3e-7ce7-40b2-824d-301c8fee761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:24.388309 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a32f3e-7ce7-40b2-824d-301c8fee761d None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:24.388590 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a32f3e-7ce7-40b2-824d-301c8fee761d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:24.388863 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a32f3e-7ce7-40b2-824d-301c8fee761d None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:24.389626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a32f3e-7ce7-40b2-824d-301c8fee761d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:24.391050 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a32f3e-7ce7-40b2-824d-301c8fee761d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:24.413115 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 377/743] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:16:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:25.227351 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd3551-f779-4222-b5e0-a95c152341f5 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.228133 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd3551-f779-4222-b5e0-a95c152341f5 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.228133 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd3551-f779-4222-b5e0-a95c152341f5 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.229302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 367/744] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:25.234806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50fe3a-39f5-4e6c-b145-bc97f61b23d0 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.235096 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50fe3a-39f5-4e6c-b145-bc97f61b23d0 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.235367 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50fe3a-39f5-4e6c-b145-bc97f61b23d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.254126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-0c50fe3a-39f5-4e6c-b145-bc97f61b23d0 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:25.255307 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-0c50fe3a-39f5-4e6c-b145-bc97f61b23d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:25.266334 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d97c9-284f-4d7b-b40a-ca1860bfab50 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.266631 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d97c9-284f-4d7b-b40a-ca1860bfab50 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.266909 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d97c9-284f-4d7b-b40a-ca1860bfab50 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.268259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 368/745] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:25.273105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bbef1-44cd-465c-b30c-ea18fd9689bd None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.273380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bbef1-44cd-465c-b30c-ea18fd9689bd None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.273654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bbef1-44cd-465c-b30c-ea18fd9689bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.291528 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-ed5bbef1-44cd-465c-b30c-ea18fd9689bd None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:25.292764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-ed5bbef1-44cd-465c-b30c-ea18fd9689bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:25.337851 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 378/746] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:25 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:25.346129 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:25.367617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 369/747] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:25 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:16:25.668791 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50fe3a-39f5-4e6c-b145-bc97f61b23d0 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:25.704022 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bbef1-44cd-465c-b30c-ea18fd9689bd None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:25.760639 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:25.778513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50fe3a-39f5-4e6c-b145-bc97f61b23d0 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:25.815582 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:25.816241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.816518 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.816786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.817360 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:25.817872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bbef1-44cd-465c-b30c-ea18fd9689bd None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:25.818721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:25.828303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:25.829245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:25.830287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 379/748] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:25.835108 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:25.861156 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf63a3-a04d-45c4-9859-5cc1546b27b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:25.861771 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf63a3-a04d-45c4-9859-5cc1546b27b1 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.862047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf63a3-a04d-45c4-9859-5cc1546b27b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.862331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf63a3-a04d-45c4-9859-5cc1546b27b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.913461 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:25.933705 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf63a3-a04d-45c4-9859-5cc1546b27b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:25.935169 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf63a3-a04d-45c4-9859-5cc1546b27b1 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:25.945984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1a2df-83c0-45a5-bcaf-7c040f330d6d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:25.982377 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:25.983034 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.983546 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.983973 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.984572 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:25.984876 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:25.986237 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:25.995798 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 380/749] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:25.996815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:26.018048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:26.045795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 370/750] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 00:16:26.051235 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf63a3-a04d-45c4-9859-5cc1546b27b1 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:26.123281 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb60b4e-e2c1-4175-a8ec-c2e9aea1d51b None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:26.138377 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:26.159485 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf63a3-a04d-45c4-9859-5cc1546b27b1 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:26.164613 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:26.165221 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.165501 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.165771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.166399 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:26.166699 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:26.168098 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:26.174303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 381/751] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:26.198941 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0e0d0-3d3e-4066-a6d7-220bc241c95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:26.200032 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e0d0-3d3e-4066-a6d7-220bc241c95c None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.200519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e0d0-3d3e-4066-a6d7-220bc241c95c None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.200991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e0d0-3d3e-4066-a6d7-220bc241c95c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.213798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0e0d0-3d3e-4066-a6d7-220bc241c95c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:26.215714 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0e0d0-3d3e-4066-a6d7-220bc241c95c None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-41c0e0d0-3d3e-4066-a6d7-220bc241c95c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:26.234323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:26.235777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:26.242091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:26.242091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:26.242091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:26.242091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 371/752] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:26.242993 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:26.370716 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:26.396340 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cd30-d4c8-4484-a498-d1696bf68a26 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:26.432751 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd3599-34e4-4900-b91b-989c8abd2339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:26.433354 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3599-34e4-4900-b91b-989c8abd2339 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.433625 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3599-34e4-4900-b91b-989c8abd2339 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.433888 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3599-34e4-4900-b91b-989c8abd2339 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.434522 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd3599-34e4-4900-b91b-989c8abd2339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:26.434823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd3599-34e4-4900-b91b-989c8abd2339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:26.436738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd3599-34e4-4900-b91b-989c8abd2339 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:26.449135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 382/753] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:26.664773 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337a264-9297-4c45-8db5-9cbb0a72394e None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.665019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337a264-9297-4c45-8db5-9cbb0a72394e None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.665254 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337a264-9297-4c45-8db5-9cbb0a72394e None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.666737 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 372/754] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:26.673006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca9e4-3842-4174-a374-e7b4a76006e8 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.673471 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca9e4-3842-4174-a374-e7b4a76006e8 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.673578 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca9e4-3842-4174-a374-e7b4a76006e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.691784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b67ca9e4-3842-4174-a374-e7b4a76006e8 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:26.692977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b67ca9e4-3842-4174-a374-e7b4a76006e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:26.764725 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 383/755] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:27.094243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337a264-9297-4c45-8db5-9cbb0a72394e None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:27.323748 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337a264-9297-4c45-8db5-9cbb0a72394e None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:27.359132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:27.359673 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:27.359987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:27.360263 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:27.360840 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:27.362209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:27.364030 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:27.372251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:27.373225 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:27.375374 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 373/756] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:27.379865 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca9e4-3842-4174-a374-e7b4a76006e8 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:27.448774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:27.486848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca9e4-3842-4174-a374-e7b4a76006e8 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:27.520604 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359edc0-e62d-40c9-b17e-d2980c3bac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:27.521203 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359edc0-e62d-40c9-b17e-d2980c3bac99 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:27.521479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359edc0-e62d-40c9-b17e-d2980c3bac99 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:27.521746 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359edc0-e62d-40c9-b17e-d2980c3bac99 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:27.522365 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359edc0-e62d-40c9-b17e-d2980c3bac99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:27.522662 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359edc0-e62d-40c9-b17e-d2980c3bac99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:27.524058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359edc0-e62d-40c9-b17e-d2980c3bac99 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:27.528572 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 384/757] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:27.535107 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:27.636964 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f21b3-57cb-4e0c-bff9-48b8f60bae3e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:27.670753 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb388729-b80c-4f2c-9de9-6de5aed397ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:27.671347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388729-b80c-4f2c-9de9-6de5aed397ac None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:27.671626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388729-b80c-4f2c-9de9-6de5aed397ac None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:27.671934 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388729-b80c-4f2c-9de9-6de5aed397ac None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:27.672704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb388729-b80c-4f2c-9de9-6de5aed397ac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:27.673006 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb388729-b80c-4f2c-9de9-6de5aed397ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:27.674367 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb388729-b80c-4f2c-9de9-6de5aed397ac None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:27.679077 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 374/758] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:28.408417 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42036e38-88fc-414e-ae52-f106527b5284 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:28.408986 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42036e38-88fc-414e-ae52-f106527b5284 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:28.408986 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42036e38-88fc-414e-ae52-f106527b5284 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:28.410285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 385/759] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:28.415613 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2020-4792-4999-aa5f-11b609747f44 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:28.416026 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2020-4792-4999-aa5f-11b609747f44 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:28.416324 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2020-4792-4999-aa5f-11b609747f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:28.435105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-24bb2020-4792-4999-aa5f-11b609747f44 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:28.437277 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-24bb2020-4792-4999-aa5f-11b609747f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:28.492386 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:28.505787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 375/760] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:28 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:28.829942 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42036e38-88fc-414e-ae52-f106527b5284 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:28.931712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42036e38-88fc-414e-ae52-f106527b5284 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:28.960306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:28.965743 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162f7f4-6d71-47ec-8492-464629adfe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:28.966350 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162f7f4-6d71-47ec-8492-464629adfe92 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:28.966629 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162f7f4-6d71-47ec-8492-464629adfe92 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:28.966899 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162f7f4-6d71-47ec-8492-464629adfe92 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:28.968176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162f7f4-6d71-47ec-8492-464629adfe92 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:28.969656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162f7f4-6d71-47ec-8492-464629adfe92 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:28.984637 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 386/761] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:16:28 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:29.865080 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba66a47-5bc0-4002-ae4d-e5c72a1ec587 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:29.865670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba66a47-5bc0-4002-ae4d-e5c72a1ec587 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:29.865670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba66a47-5bc0-4002-ae4d-e5c72a1ec587 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:29.866944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 376/762] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:29.872302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15bccd-b55e-4fc5-8555-c8dee1afedc1 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:29.872758 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15bccd-b55e-4fc5-8555-c8dee1afedc1 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:29.872859 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15bccd-b55e-4fc5-8555-c8dee1afedc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:29.891700 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-1a15bccd-b55e-4fc5-8555-c8dee1afedc1 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:29.892906 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-1a15bccd-b55e-4fc5-8555-c8dee1afedc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:29.964180 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 387/763] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:29 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:30.289113 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba66a47-5bc0-4002-ae4d-e5c72a1ec587 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:30.388450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba66a47-5bc0-4002-ae4d-e5c72a1ec587 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:30.422864 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab393a78-da45-4baf-b9b0-8a09f47b5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:30.423451 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393a78-da45-4baf-b9b0-8a09f47b5ec1 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:30.423752 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393a78-da45-4baf-b9b0-8a09f47b5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:30.424048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393a78-da45-4baf-b9b0-8a09f47b5ec1 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:30.424677 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab393a78-da45-4baf-b9b0-8a09f47b5ec1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:30.426215 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab393a78-da45-4baf-b9b0-8a09f47b5ec1 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:30.441677 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 377/764] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:16:30 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:31.214298 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccb9e-eb9f-45e1-97af-149a64cc117f None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.214857 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccb9e-eb9f-45e1-97af-149a64cc117f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.214857 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccb9e-eb9f-45e1-97af-149a64cc117f None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.216218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 388/765] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:31.221528 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad4906-539c-4d8b-a1f8-f7862e6683c4 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.221937 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad4906-539c-4d8b-a1f8-f7862e6683c4 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.222133 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad4906-539c-4d8b-a1f8-f7862e6683c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.240766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-89ad4906-539c-4d8b-a1f8-f7862e6683c4 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:31.241996 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-89ad4906-539c-4d8b-a1f8-f7862e6683c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:31.288954 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:31.315726 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 378/766] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:31.644924 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccb9e-eb9f-45e1-97af-149a64cc117f None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:31.744280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccb9e-eb9f-45e1-97af-149a64cc117f None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:31.762213 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:31.780440 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:31.781054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.781325 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.781595 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.782170 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:31.783525 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:31.792133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:31.793252 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:31.794666 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:31.796665 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 389/767] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 24 00:16:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:31.799879 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad4906-539c-4d8b-a1f8-f7862e6683c4 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:31.897820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad4906-539c-4d8b-a1f8-f7862e6683c4 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:31.932002 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:31.932598 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.932876 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.933144 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.933765 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:31.934062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:31.935421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:31.940690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 379/768] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 00:16:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:31.946329 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:32.046986 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba99a3-131e-4d66-8b5e-3dd97caee264 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:32.081725 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:32.082326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:32.082604 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:32.082871 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:32.083494 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:32.083793 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:32.085182 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:32.089934 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 390/769] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 00:16:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:32.096125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:32.139837 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:32.196240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9e2d-9c27-4580-bf80-c3a414613461 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:32.230598 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4155d54-7229-4a85-983c-9e9fe4a547dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:32.231276 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4155d54-7229-4a85-983c-9e9fe4a547dd None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:32.231453 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4155d54-7229-4a85-983c-9e9fe4a547dd None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:32.231720 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4155d54-7229-4a85-983c-9e9fe4a547dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:32.232440 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4155d54-7229-4a85-983c-9e9fe4a547dd None admin] RBAC: Adding query filter params (interface=public, service_id=02e3e701523842f7a238b4bd608ab980, region_id=RegionOne) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:32.233305 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4155d54-7229-4a85-983c-9e9fe4a547dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:32.234716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4155d54-7229-4a85-983c-9e9fe4a547dd None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:32.242059 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 380/770] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 00:16:32 2022] GET /identity/v3/endpoints?service_id=02e3e701523842f7a238b4bd608ab980&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:32.247643 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:32.294562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:32.347699 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe2a55-8ee6-4ca9-b8d9-d57329cdc144 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:32.385758 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38474ee5-3e03-43fe-b331-de511abcfa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:32.386358 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474ee5-3e03-43fe-b331-de511abcfa15 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:32.386636 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474ee5-3e03-43fe-b331-de511abcfa15 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:32.386905 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474ee5-3e03-43fe-b331-de511abcfa15 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:32.387502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38474ee5-3e03-43fe-b331-de511abcfa15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:32.388944 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38474ee5-3e03-43fe-b331-de511abcfa15 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:32.394833 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 391/771] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 00:16:32 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:16:32.653212 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296440-6784-4e6f-a034-4db4320c598c None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:32.653408 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296440-6784-4e6f-a034-4db4320c598c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:32.653680 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296440-6784-4e6f-a034-4db4320c598c None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:32.655522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 381/772] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:32.660854 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06877-3a25-4d98-8eaf-59555a9c8155 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:32.661144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06877-3a25-4d98-8eaf-59555a9c8155 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:32.661416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06877-3a25-4d98-8eaf-59555a9c8155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:32.680777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-0ef06877-3a25-4d98-8eaf-59555a9c8155 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:32.681973 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-0ef06877-3a25-4d98-8eaf-59555a9c8155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:32.748962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 392/773] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:33.086845 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296440-6784-4e6f-a034-4db4320c598c None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:33.188295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296440-6784-4e6f-a034-4db4320c598c None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:33.195010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:33.222117 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:33.222727 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:33.223005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:33.223276 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:33.223879 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:33.225234 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:33.234448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:33.235877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:33.236731 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 382/774] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:33.241784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef06877-3a25-4d98-8eaf-59555a9c8155 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:33.282444 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:33.339536 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef06877-3a25-4d98-8eaf-59555a9c8155 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:33.372800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:33.374046 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:33.374328 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:33.374598 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:33.375228 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:33.375527 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:33.376937 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:33.381628 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 393/775] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:33.387455 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:33.489627 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783bdd-eb07-47cf-8bbd-49e28da569ed None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:33.527061 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:33.527656 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:33.527972 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:33.528248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:33.528873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:33.529176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:33.531885 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:33.536759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 383/776] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:33.542898 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:33.640939 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d5ce8-3c5d-4c77-a1b0-e518e506a291 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:33.643123 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:33.675603 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de4e48-ea99-4bf2-86f5-073e0530b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:33.676243 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de4e48-ea99-4bf2-86f5-073e0530b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:33.676522 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de4e48-ea99-4bf2-86f5-073e0530b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:33.676796 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de4e48-ea99-4bf2-86f5-073e0530b6a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:33.677495 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de4e48-ea99-4bf2-86f5-073e0530b6a5 None admin] RBAC: Adding query filter params (interface=public, service_id=505fe6bd478f4081a5833559e5f18fd0, region_id=RegionOne) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:33.677802 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de4e48-ea99-4bf2-86f5-073e0530b6a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:33.679174 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de4e48-ea99-4bf2-86f5-073e0530b6a5 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:33.684170 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 394/777] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 00:16:33 2022] GET /identity/v3/endpoints?service_id=505fe6bd478f4081a5833559e5f18fd0&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:33.689755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:33.723804 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:33.796618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f4942-88c2-4bb0-9365-cbc0d1816c88 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:33.829502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec8ade-0435-43cc-b152-5df0112f1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:33.830094 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8ade-0435-43cc-b152-5df0112f1372 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:33.830371 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8ade-0435-43cc-b152-5df0112f1372 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:33.830642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8ade-0435-43cc-b152-5df0112f1372 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:33.831232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec8ade-0435-43cc-b152-5df0112f1372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:33.832622 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec8ade-0435-43cc-b152-5df0112f1372 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:33.838332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 384/778] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 00:16:33 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:16:34.605665 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c56c43-109e-42bc-9af4-95291a9adfbd None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:34.606218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c56c43-109e-42bc-9af4-95291a9adfbd None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:34.606316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c56c43-109e-42bc-9af4-95291a9adfbd None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:34.608321 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 395/779] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:34.614003 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5135b-c570-4ffb-9dd5-826ffd23d334 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:34.614470 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5135b-c570-4ffb-9dd5-826ffd23d334 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:34.614571 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5135b-c570-4ffb-9dd5-826ffd23d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:34.633653 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-70f5135b-c570-4ffb-9dd5-826ffd23d334 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:34.634848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-70f5135b-c570-4ffb-9dd5-826ffd23d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:34.700095 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 385/780] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:34 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:35.033648 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c56c43-109e-42bc-9af4-95291a9adfbd None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:35.135486 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c56c43-109e-42bc-9af4-95291a9adfbd None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:35.171576 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:35.172236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:35.172512 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:35.172778 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:35.173352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:35.174716 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:35.183306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:35.184300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:35.186351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 396/781] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 24 00:16:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:35.192201 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5135b-c570-4ffb-9dd5-826ffd23d334 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:35.218717 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:35.291149 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5135b-c570-4ffb-9dd5-826ffd23d334 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:35.325680 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:35.326827 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:35.327187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:35.327460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:35.328118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:35.328417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:35.329771 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:35.334370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 386/782] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 00:16:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:35.340045 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:35.371126 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:35.440782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911252c-1fbf-45e1-a24b-c90a80d00ccc None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:35.473684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d969cd-351d-4d0c-9a6c-ed6eeeea3ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:35.474299 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d969cd-351d-4d0c-9a6c-ed6eeeea3ffe None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:35.474577 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d969cd-351d-4d0c-9a6c-ed6eeeea3ffe None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:35.474849 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d969cd-351d-4d0c-9a6c-ed6eeeea3ffe None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:35.475476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d969cd-351d-4d0c-9a6c-ed6eeeea3ffe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:35.475777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d969cd-351d-4d0c-9a6c-ed6eeeea3ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:35.477175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d969cd-351d-4d0c-9a6c-ed6eeeea3ffe None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:35.482144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 397/783] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 00:16:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:35.488737 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:35.580955 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:35.589746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c73d88-a487-4d55-8738-7604440c6485 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:35.623714 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7585e-8561-450e-a4cf-7b9d4dd1e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:35.624404 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7585e-8561-450e-a4cf-7b9d4dd1e134 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:35.624609 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7585e-8561-450e-a4cf-7b9d4dd1e134 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:35.624879 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7585e-8561-450e-a4cf-7b9d4dd1e134 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:35.625523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7585e-8561-450e-a4cf-7b9d4dd1e134 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:35.626879 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7585e-8561-450e-a4cf-7b9d4dd1e134 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:35.647041 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 387/784] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:16:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:36.089508 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de32e8c-0de5-4fbc-85e9-476beba81713 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.090037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de32e8c-0de5-4fbc-85e9-476beba81713 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.090147 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de32e8c-0de5-4fbc-85e9-476beba81713 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.091504 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 398/785] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:36.097021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a09-f6df-4a45-9473-34c4ec1546ae None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.097380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a09-f6df-4a45-9473-34c4ec1546ae None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.097768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a09-f6df-4a45-9473-34c4ec1546ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.116458 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f3291a09-f6df-4a45-9473-34c4ec1546ae None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:36.117649 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f3291a09-f6df-4a45-9473-34c4ec1546ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:36.191922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 388/786] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:36.525774 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de32e8c-0de5-4fbc-85e9-476beba81713 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:36.637308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:36.646188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de32e8c-0de5-4fbc-85e9-476beba81713 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:36.680913 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:36.681542 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.681818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.682090 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.682668 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:36.684059 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:36.692938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:36.694020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:16:36.694821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:36.696213 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 399/787] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:36.699867 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291a09-f6df-4a45-9473-34c4ec1546ae None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:36.782039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:36.808266 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291a09-f6df-4a45-9473-34c4ec1546ae None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:36.842720 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:36.843379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.843657 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.843965 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.844598 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:36.844902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:36.846266 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:36.850894 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 389/788] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:36.856578 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:36.960500 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170cc94-5045-4126-b8c9-554511d40ac5 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:36.992934 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19c0fa-96b8-4aa5-8a87-d2f864874094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:36.993524 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19c0fa-96b8-4aa5-8a87-d2f864874094 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.993798 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19c0fa-96b8-4aa5-8a87-d2f864874094 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.994063 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19c0fa-96b8-4aa5-8a87-d2f864874094 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.994681 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19c0fa-96b8-4aa5-8a87-d2f864874094 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:36.994975 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19c0fa-96b8-4aa5-8a87-d2f864874094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:36.996355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19c0fa-96b8-4aa5-8a87-d2f864874094 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:37.001848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 400/789] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 00:16:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:37.007645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:37.104646 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c574fe1-bc40-4c88-a977-fa0497b33475 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:37.138281 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7675a6-f5ee-45fd-8f65-11b8296dccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:37.139466 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7675a6-f5ee-45fd-8f65-11b8296dccb5 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:37.139746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7675a6-f5ee-45fd-8f65-11b8296dccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:37.140045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7675a6-f5ee-45fd-8f65-11b8296dccb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:37.140709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7675a6-f5ee-45fd-8f65-11b8296dccb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:37.142068 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7675a6-f5ee-45fd-8f65-11b8296dccb5 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:37.150468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:37.162614 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 390/790] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:16:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:37.885302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643070-979c-4f62-ba71-611e138d4f6c None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:37.885858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643070-979c-4f62-ba71-611e138d4f6c None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:37.885956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643070-979c-4f62-ba71-611e138d4f6c None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:37.887297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 401/791] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:37.892970 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f58b3-1cb5-445b-9203-5fbcdd064705 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:37.893381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f58b3-1cb5-445b-9203-5fbcdd064705 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:37.893660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f58b3-1cb5-445b-9203-5fbcdd064705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:37.912513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-483f58b3-1cb5-445b-9203-5fbcdd064705 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:37.913694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-483f58b3-1cb5-445b-9203-5fbcdd064705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:37.984765 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 391/792] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:37 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:38.325008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643070-979c-4f62-ba71-611e138d4f6c None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:38.351869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:38.428744 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643070-979c-4f62-ba71-611e138d4f6c None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:38.462300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:38.462912 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:38.463266 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:38.463541 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] PATH_INFO: `/v3/services/compute` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:38.464141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:38.465491 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:38.476295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:38.477280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:38.478124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 402/793] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:38.481492 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f58b3-1cb5-445b-9203-5fbcdd064705 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:38.580330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f58b3-1cb5-445b-9203-5fbcdd064705 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:38.600194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:38.616284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c955-6912-4195-a422-151caff063bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:38.616881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c955-6912-4195-a422-151caff063bc None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:38.617160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c955-6912-4195-a422-151caff063bc None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:38.617430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c955-6912-4195-a422-151caff063bc None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:38.618057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c955-6912-4195-a422-151caff063bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:38.618357 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c955-6912-4195-a422-151caff063bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:38.619722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c955-6912-4195-a422-151caff063bc None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:38.624564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 392/794] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:38.632084 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:38.725538 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:38.738208 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968679-564d-4b50-9a66-ca3bd10f843b None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:38.770904 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2fcab-659c-4267-a151-9c253a9a0d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:38.771502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2fcab-659c-4267-a151-9c253a9a0d53 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:38.771779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2fcab-659c-4267-a151-9c253a9a0d53 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:38.772078 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2fcab-659c-4267-a151-9c253a9a0d53 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:38.772697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2fcab-659c-4267-a151-9c253a9a0d53 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:38.772996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2fcab-659c-4267-a151-9c253a9a0d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:38.774352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2fcab-659c-4267-a151-9c253a9a0d53 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:38.780060 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 403/795] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:39.365080 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335efc27-cb25-4d31-84d4-aef4ae2d8095 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:39.365608 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335efc27-cb25-4d31-84d4-aef4ae2d8095 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:39.365608 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335efc27-cb25-4d31-84d4-aef4ae2d8095 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:39.366934 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 393/796] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:39.372518 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e424e2-08bf-455c-9b64-54f7093b2014 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:39.373449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e424e2-08bf-455c-9b64-54f7093b2014 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:39.373772 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e424e2-08bf-455c-9b64-54f7093b2014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:39.393025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e7e424e2-08bf-455c-9b64-54f7093b2014 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:39.394194 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e7e424e2-08bf-455c-9b64-54f7093b2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:39.458970 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 404/797] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:39 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:39.783075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335efc27-cb25-4d31-84d4-aef4ae2d8095 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:39.883967 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335efc27-cb25-4d31-84d4-aef4ae2d8095 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:39.920546 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:39.921137 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:39.921413 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:39.921683 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:39.922307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:39.923722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:39.926323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING keystone.server.flask.common [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 00:16:39.943592 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.sql.core [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 00:16:39.943592 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 00:16:39.943592 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [parameters: {'id': '4da75678bf95401f91f6756d4404b6cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 00:16:39.943592 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4da75678bf95401f91f6756d4404b6cc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4da75678bf95401f91f6756d4404b6cc. Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application conn.query(q) Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 00:16:39.960637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result.read() Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 00:16:39.961448 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application next(self.gen) Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application yield resource Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application next(self.gen) Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise self.value Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application session.commit() Aug 24 00:16:39.962405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.session.flush() Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application compat.raise_( Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 00:16:39.963278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 00:16:39.964231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application conn.query(q) Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result.read() Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 00:16:39.965062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [parameters: {'id': '4da75678bf95401f91f6756d4404b6cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:39.965942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:39.967321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4da75678bf95401f91f6756d4404b6cc. Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:39.970923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 394/798] 10.222.0.70 () {60 vars in 1140 bytes} [Wed Aug 24 00:16:39 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:39.973133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e424e2-08bf-455c-9b64-54f7093b2014 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:40.049940 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:40.068762 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e424e2-08bf-455c-9b64-54f7093b2014 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:40.102492 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129007e-5531-4904-a9f1-a2a44ea7b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:40.103114 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129007e-5531-4904-a9f1-a2a44ea7b345 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:40.103393 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129007e-5531-4904-a9f1-a2a44ea7b345 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:40.103664 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129007e-5531-4904-a9f1-a2a44ea7b345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:40.110247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129007e-5531-4904-a9f1-a2a44ea7b345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:40.111688 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129007e-5531-4904-a9f1-a2a44ea7b345 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-5129007e-5531-4904-a9f1-a2a44ea7b345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:40.122429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:40.124021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:40.125061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 405/799] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:40.130499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:40.173229 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:40.231378 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f73a6e-256d-4e9f-8c25-62bd3efd6db9 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:40.265034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870f5f-12a7-48ef-92c0-80976075e035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:40.265626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f5f-12a7-48ef-92c0-80976075e035 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:40.265904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f5f-12a7-48ef-92c0-80976075e035 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:40.266177 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f5f-12a7-48ef-92c0-80976075e035 None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:40.266857 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870f5f-12a7-48ef-92c0-80976075e035 None admin] RBAC: Adding query filter params (name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:40.267156 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870f5f-12a7-48ef-92c0-80976075e035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:40.268806 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870f5f-12a7-48ef-92c0-80976075e035 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:40.288351 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 395/800] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:40.981680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e7bdc-4907-4ed4-9af5-1417059511d5 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:40.982839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e7bdc-4907-4ed4-9af5-1417059511d5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:40.982839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e7bdc-4907-4ed4-9af5-1417059511d5 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:40.984213 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 406/801] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:40.989763 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7160-e9ef-4ca8-9a14-a860c53ef075 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:40.990194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7160-e9ef-4ca8-9a14-a860c53ef075 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:40.990308 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7160-e9ef-4ca8-9a14-a860c53ef075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:41.008902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-a9be7160-e9ef-4ca8-9a14-a860c53ef075 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:41.010465 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-a9be7160-e9ef-4ca8-9a14-a860c53ef075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:41.076654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 396/802] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:40 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:41.400779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e7bdc-4907-4ed4-9af5-1417059511d5 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:41.505519 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e7bdc-4907-4ed4-9af5-1417059511d5 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:41.538795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b3456-d425-44d6-9dd1-597280be75f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:41.539400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3456-d425-44d6-9dd1-597280be75f0 None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:41.539681 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3456-d425-44d6-9dd1-597280be75f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:41.539991 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3456-d425-44d6-9dd1-597280be75f0 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:41.540661 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b3456-d425-44d6-9dd1-597280be75f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:41.542059 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b3456-d425-44d6-9dd1-597280be75f0 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:41.556856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 407/803] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:16:41 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:42.607569 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d2fa-3846-474a-86c9-fc9b3debb773 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:42.608157 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d2fa-3846-474a-86c9-fc9b3debb773 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:42.608157 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d2fa-3846-474a-86c9-fc9b3debb773 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:42.609513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 397/804] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:42.615216 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385b44-c1b9-458d-b781-fe36abb32f9b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:42.615668 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385b44-c1b9-458d-b781-fe36abb32f9b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:42.615753 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385b44-c1b9-458d-b781-fe36abb32f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:42.622324 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:42.637921 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b1385b44-c1b9-458d-b781-fe36abb32f9b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:42.639835 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b1385b44-c1b9-458d-b781-fe36abb32f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:42.730720 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 408/805] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:42 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:43.110017 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d2fa-3846-474a-86c9-fc9b3debb773 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:43.139677 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:43.215531 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d2fa-3846-474a-86c9-fc9b3debb773 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:43.251533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:43.252165 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:43.252445 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:43.252716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:43.253344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:43.254769 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:43.269259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.sql.core [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 00:16:43.269259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 00:16:43.269259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [parameters: {'user_id': '928590d72fac4d42b96fe63eed9d2248', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 00:16:43.269259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application conn.query(q) Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result.read() Aug 24 00:16:43.275539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 00:16:43.276417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application next(self.gen) Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application yield resource Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application next(self.gen) Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise self.value Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application session.commit() Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 00:16:43.277354 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.session.flush() Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application compat.raise_( Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 00:16:43.278239 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 00:16:43.279660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application conn.query(q) Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application result.read() Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 00:16:43.280539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [parameters: {'user_id': '928590d72fac4d42b96fe63eed9d2248', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:43.281331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 00:16:43.282118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 00:16:43.283011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 00:16:43.283011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 00:16:43.283011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 00:16:43.283011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 00:16:43.283011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 00:16:43.283011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:43.283011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 398/806] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 24 00:16:43 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:43.283573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1385b44-c1b9-458d-b781-fe36abb32f9b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:43.390033 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1385b44-c1b9-458d-b781-fe36abb32f9b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:43.415651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:43.424856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f364f2-4f03-41fa-b842-2c6145f86683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:43.425495 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f364f2-4f03-41fa-b842-2c6145f86683 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:43.425776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f364f2-4f03-41fa-b842-2c6145f86683 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:43.426046 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f364f2-4f03-41fa-b842-2c6145f86683 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:43.433493 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f364f2-4f03-41fa-b842-2c6145f86683 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:43.434938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f364f2-4f03-41fa-b842-2c6145f86683 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-b3f364f2-4f03-41fa-b842-2c6145f86683 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:43.447002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:43.448169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:43.449190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 409/807] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:43.454232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:43.549178 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:43.559000 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e699c-b8bd-4f12-a54c-7de7f4809970 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:43.592917 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bfd0b-d677-43a3-830b-a20a5827fe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:43.593513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfd0b-d677-43a3-830b-a20a5827fe28 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:43.593789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfd0b-d677-43a3-830b-a20a5827fe28 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:43.594058 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfd0b-d677-43a3-830b-a20a5827fe28 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:43.594759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bfd0b-d677-43a3-830b-a20a5827fe28 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:43.595105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bfd0b-d677-43a3-830b-a20a5827fe28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:43.596736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bfd0b-d677-43a3-830b-a20a5827fe28 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:43.634333 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 399/808] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 00:16:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:43.952973 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeaa01-7c44-4105-b6ac-c6eeb589340a None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:43.953494 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeaa01-7c44-4105-b6ac-c6eeb589340a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:43.953494 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeaa01-7c44-4105-b6ac-c6eeb589340a None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:43.954834 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 410/809] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:43.960242 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2572505-1ba6-4a0f-ab4a-54027a7fde35 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:43.960525 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2572505-1ba6-4a0f-ab4a-54027a7fde35 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:43.960799 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2572505-1ba6-4a0f-ab4a-54027a7fde35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:43.979150 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-e2572505-1ba6-4a0f-ab4a-54027a7fde35 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:43.980681 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-e2572505-1ba6-4a0f-ab4a-54027a7fde35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:44.046913 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 400/810] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:43 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:44.375595 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeaa01-7c44-4105-b6ac-c6eeb589340a None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:44.477727 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeaa01-7c44-4105-b6ac-c6eeb589340a None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:44.510931 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:44.511551 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:44.511853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:44.512123 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] PATH_INFO: `/v3/services/compute` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:44.512696 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:44.514835 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:44.523296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:44.524468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:16:44.525290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 411/811] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:44.530884 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2572505-1ba6-4a0f-ab4a-54027a7fde35 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:44.608523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:44.627560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2572505-1ba6-4a0f-ab4a-54027a7fde35 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:44.660184 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:44.660761 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:44.661032 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:44.661296 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:44.661989 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] RBAC: Adding query filter params (name=compute) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:44.662289 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:44.663628 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:44.668542 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 401/812] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:44.674363 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:44.733445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:44.780923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfaedd-5f0b-4d16-bce7-9cdaa674184c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:44.813866 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:44.814482 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:44.814753 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:44.815017 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:44.815628 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:44.815951 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:44.817308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:44.821853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 412/813] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:44.828679 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:44.927088 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0785a9-8ee7-47f5-862b-abce172574cd None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:44.959934 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1da31-1851-4aa5-97f7-cdadbd6bb693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:44.960523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1da31-1851-4aa5-97f7-cdadbd6bb693 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:44.960803 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1da31-1851-4aa5-97f7-cdadbd6bb693 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:44.961076 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1da31-1851-4aa5-97f7-cdadbd6bb693 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:44.961772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1da31-1851-4aa5-97f7-cdadbd6bb693 None admin] RBAC: Adding query filter params (interface=public, service_id=b1f1d7c7a9274b508b8c3f9c47f1a444, region_id=RegionOne) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:44.962079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1da31-1851-4aa5-97f7-cdadbd6bb693 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:44.963429 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1da31-1851-4aa5-97f7-cdadbd6bb693 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:44.968347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 402/814] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 00:16:44 2022] GET /identity/v3/endpoints?service_id=b1f1d7c7a9274b508b8c3f9c47f1a444&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:44.973968 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:45.072349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe51bc-e851-44f9-9ba4-edfc8eff3be3 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:45.088153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:45.106048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc6dd0-e901-43b8-af18-ed4a027e3e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:45.106649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6dd0-e901-43b8-af18-ed4a027e3e57 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:45.107467 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6dd0-e901-43b8-af18-ed4a027e3e57 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:45.107843 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6dd0-e901-43b8-af18-ed4a027e3e57 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:45.108481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc6dd0-e901-43b8-af18-ed4a027e3e57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:45.109830 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc6dd0-e901-43b8-af18-ed4a027e3e57 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:45.115842 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 413/815] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 00:16:44 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:16:47.291819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d270b4-4f31-4788-af61-cf46f1cb1297 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:47.292405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d270b4-4f31-4788-af61-cf46f1cb1297 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:47.292405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d270b4-4f31-4788-af61-cf46f1cb1297 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:47.293987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 403/816] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:47.299743 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1d9b-bf39-446f-b2b9-76aaf2887429 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:47.300214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1d9b-bf39-446f-b2b9-76aaf2887429 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:47.300306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1d9b-bf39-446f-b2b9-76aaf2887429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:47.318565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-61aa1d9b-bf39-446f-b2b9-76aaf2887429 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:47.319746 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-61aa1d9b-bf39-446f-b2b9-76aaf2887429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:47.388140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 414/817] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:47 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:47.715185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d270b4-4f31-4788-af61-cf46f1cb1297 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:47.727006 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:47.818685 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d270b4-4f31-4788-af61-cf46f1cb1297 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:47.851618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:47.852264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:47.852545 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:47.852816 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:47.853387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:47.854745 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:47.864001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:47.865045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:16:47.865878 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 404/818] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:47.871010 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa1d9b-bf39-446f-b2b9-76aaf2887429 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:47.967354 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa1d9b-bf39-446f-b2b9-76aaf2887429 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:47.977519 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:48.001858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:48.002548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:48.002914 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:48.003231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:48.004015 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:48.004312 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:48.005943 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:48.011282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 415/819] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:48.017142 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:48.086749 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:48.116777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6886-a809-44ec-a5e5-dfc0ac543ee4 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:48.150206 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee783e3b-eba9-4995-af59-8b49416c76a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:48.150797 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783e3b-eba9-4995-af59-8b49416c76a0 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:48.151073 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783e3b-eba9-4995-af59-8b49416c76a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:48.151344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783e3b-eba9-4995-af59-8b49416c76a0 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:48.151991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee783e3b-eba9-4995-af59-8b49416c76a0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:48.152292 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee783e3b-eba9-4995-af59-8b49416c76a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:48.154391 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee783e3b-eba9-4995-af59-8b49416c76a0 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:48.159177 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 405/820] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 00:16:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:48.165215 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:48.263670 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79df948-a337-4f1d-87f1-c0a9e1294815 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:48.297306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43d926-c76c-49f0-973e-149c2130534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:48.297900 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d926-c76c-49f0-973e-149c2130534c None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:48.298180 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d926-c76c-49f0-973e-149c2130534c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:48.298451 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d926-c76c-49f0-973e-149c2130534c None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:48.299106 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43d926-c76c-49f0-973e-149c2130534c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:48.300506 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43d926-c76c-49f0-973e-149c2130534c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:48.319555 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 416/821] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:16:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:58.157234 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=32 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:58.315419 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:51.219601 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2077ff5-1802-4124-883a-c918eaf5988c None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:51.220209 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2077ff5-1802-4124-883a-c918eaf5988c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:51.220468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2077ff5-1802-4124-883a-c918eaf5988c None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:51.222451 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 406/822] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:17:51.227634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c66a-3d76-4a6a-a8dc-5aaa6fb31e47 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:51.228160 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c66a-3d76-4a6a-a8dc-5aaa6fb31e47 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:51.228445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c66a-3d76-4a6a-a8dc-5aaa6fb31e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:51.248268 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-aa43c66a-3d76-4a6a-a8dc-5aaa6fb31e47 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:17:51.249501 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-aa43c66a-3d76-4a6a-a8dc-5aaa6fb31e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:17:51.336176 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 417/823] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:17:51 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:17:51.736865 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2077ff5-1802-4124-883a-c918eaf5988c None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:51.868774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2077ff5-1802-4124-883a-c918eaf5988c None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:51.911435 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:51.912141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:51.912412 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:51.912750 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:51.925494 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:51.926955 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:17:51.945650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:17:51.947507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:17:51.948553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:17:51.948553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:17:51.948553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:17:51.948553 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 407/824] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:17:51.954236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43c66a-3d76-4a6a-a8dc-5aaa6fb31e47 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:52.072669 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43c66a-3d76-4a6a-a8dc-5aaa6fb31e47 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:52.103637 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:52.114339 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b5917-ed96-4644-82fa-b30021a4f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:52.115038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5917-ed96-4644-82fa-b30021a4f30f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:52.115329 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5917-ed96-4644-82fa-b30021a4f30f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:52.115604 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5917-ed96-4644-82fa-b30021a4f30f None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:52.116350 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b5917-ed96-4644-82fa-b30021a4f30f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:52.116692 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b5917-ed96-4644-82fa-b30021a4f30f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:52.118326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b5917-ed96-4644-82fa-b30021a4f30f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:52.132572 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 418/825] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:17:52.139160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:52.207522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:52.267328 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea4650-b67f-4979-8cad-6bf4b99da1ab None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:52.309294 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2cb5-f27f-4b7c-a76a-a325baca46a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:52.310081 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2cb5-f27f-4b7c-a76a-a325baca46a0 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:52.310385 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2cb5-f27f-4b7c-a76a-a325baca46a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:52.310670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2cb5-f27f-4b7c-a76a-a325baca46a0 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:52.311404 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e2cb5-f27f-4b7c-a76a-a325baca46a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:52.313204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e2cb5-f27f-4b7c-a76a-a325baca46a0 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:52.339890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 408/826] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 00:17:52 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:17:54.925991 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5e16-c50e-4fb9-92ec-88b302a05381 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:54.926562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5e16-c50e-4fb9-92ec-88b302a05381 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:54.926562 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5e16-c50e-4fb9-92ec-88b302a05381 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:54.927966 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 419/827] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:17:54.934499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc92f-245f-4e01-9daa-596860ceaf7b None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:54.934919 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc92f-245f-4e01-9daa-596860ceaf7b None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:54.935048 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc92f-245f-4e01-9daa-596860ceaf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:54.955906 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-efabc92f-245f-4e01-9daa-596860ceaf7b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:17:54.957243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-efabc92f-245f-4e01-9daa-596860ceaf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:17:55.033083 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 409/828] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:17:54 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:17:55.376162 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5e16-c50e-4fb9-92ec-88b302a05381 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:55.491730 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5e16-c50e-4fb9-92ec-88b302a05381 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:55.529923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f61d9-5f57-4e35-945d-02f357af77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:55.531003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f61d9-5f57-4e35-945d-02f357af77ff None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:55.531503 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f61d9-5f57-4e35-945d-02f357af77ff None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:55.532036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f61d9-5f57-4e35-945d-02f357af77ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:55.546141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f61d9-5f57-4e35-945d-02f357af77ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-0d3f61d9-5f57-4e35-945d-02f357af77ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:17:55.551294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:17:55.552349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:17:55.553270 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 420/829] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:17:55.559580 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabc92f-245f-4e01-9daa-596860ceaf7b None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:55.603887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:55.671155 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabc92f-245f-4e01-9daa-596860ceaf7b None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:55.710398 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:55.711002 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:55.711280 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:55.711551 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:55.712916 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:55.713382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:55.714962 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:55.723763 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 410/830] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:17:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:17:55.730222 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f61d9-5f57-4e35-945d-02f357af77ff None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:55.781344 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:55.844285 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f61d9-5f57-4e35-945d-02f357af77ff None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:55.884686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:55.885229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:55.885505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:55.885770 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:55.898022 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:55.899499 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:17:55.914352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:17:55.920573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:17:55.921533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:17:55.921533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:17:55.921533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:17:55.921533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 421/831] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:17:55.921778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:56.032740 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:56.035978 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc9deb-3ec9-4934-908a-1691f0ed77c8 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:56.073720 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:56.074328 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:56.074607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:56.074880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:56.075511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:56.075812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:56.077201 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:56.091923 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 411/832] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:17:56.097597 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:56.200298 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:56.204182 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ce95-5697-406d-9ed6-affdffb56aa7 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:56.238355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:56.239919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:56.239919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:56.239919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] PATH_INFO: `/v3/users/placement` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:56.247043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:56.248514 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:17:56.260343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:17:56.261539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:17:56.262735 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:17:56.266273 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 422/833] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:17:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:17:56.267497 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:56.378966 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957587-1a05-4fb7-9ee5-2ec180b57593 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:56.419467 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:56.420091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:56.420370 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:56.420764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:56.421490 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:56.421795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:56.423313 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:56.443514 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 412/834] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 00:17:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:17:56.450248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:56.568720 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fb846-f786-4c56-a469-7080fa4cc81a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:56.605907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2f741-0e64-4824-8e32-3ea58449bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:56.606596 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2f741-0e64-4824-8e32-3ea58449bd9d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:56.606872 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2f741-0e64-4824-8e32-3ea58449bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:56.607216 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2f741-0e64-4824-8e32-3ea58449bd9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:56.635234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:56.687565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2f741-0e64-4824-8e32-3ea58449bd9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:56.689075 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2f741-0e64-4824-8e32-3ea58449bd9d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:56.797284 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 423/835] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:17:56 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:17:56.803794 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:56.825062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:56.924428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60176e-487b-46ab-a4db-0f589f44957e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:56.962316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263691-5583-4642-a850-c7be78278be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:56.963126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263691-5583-4642-a850-c7be78278be9 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:56.963406 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263691-5583-4642-a850-c7be78278be9 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:56.963680 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263691-5583-4642-a850-c7be78278be9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:56.974196 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263691-5583-4642-a850-c7be78278be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:56.975637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263691-5583-4642-a850-c7be78278be9 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-df263691-5583-4642-a850-c7be78278be9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:17:56.990432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:17:56.991483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:17:56.999057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:17:56.999057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:17:56.999057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:17:56.999057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 413/836] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:17:57.000432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2f741-0e64-4824-8e32-3ea58449bd9d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:57.067304 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:57.111790 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2f741-0e64-4824-8e32-3ea58449bd9d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:57.147194 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:57.147798 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:57.148134 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:57.148402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:57.148995 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:57.149296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:57.151370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:57.162652 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 424/837] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:17:57.169185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263691-5583-4642-a850-c7be78278be9 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:57.249187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:57.286234 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263691-5583-4642-a850-c7be78278be9 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:57.329189 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:57.329775 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:57.330008 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:57.330300 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:57.338527 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:57.340005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:17:57.351258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:17:57.352862 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:17:57.354060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 414/838] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:17:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:17:57.358217 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:57.469665 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31066e1a-6e0b-4ebe-a9e2-b7723a7332a6 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:57.492372 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:57.517430 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9ec75-3839-4f65-a305-10aa54613166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:57.518039 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9ec75-3839-4f65-a305-10aa54613166 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:57.518363 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9ec75-3839-4f65-a305-10aa54613166 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:57.518678 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9ec75-3839-4f65-a305-10aa54613166 None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:57.519435 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9ec75-3839-4f65-a305-10aa54613166 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:57.519790 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9ec75-3839-4f65-a305-10aa54613166 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:57.521429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9ec75-3839-4f65-a305-10aa54613166 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:57.534466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 425/839] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:17:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:17:57.541118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:57.662745 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31cc74-d319-4358-841e-a4e4352d68bc None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:57.697314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:57.704379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b73e2c-ca60-4c6d-a437-629b99a1ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:57.704979 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73e2c-ca60-4c6d-a437-629b99a1ae0d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:57.705258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73e2c-ca60-4c6d-a437-629b99a1ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:57.705533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73e2c-ca60-4c6d-a437-629b99a1ae0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:57.706273 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b73e2c-ca60-4c6d-a437-629b99a1ae0d None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=16dbddc103734eae8a975b8940d84394) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:57.706717 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b73e2c-ca60-4c6d-a437-629b99a1ae0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:57.708457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b73e2c-ca60-4c6d-a437-629b99a1ae0d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:57.716991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 415/840] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:17:57 2022] GET /identity/v3/role_assignments?user.id=16dbddc103734eae8a975b8940d84394&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:17:59.917023 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1060db-04d5-4774-8a83-10041816ff4b None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:59.917663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1060db-04d5-4774-8a83-10041816ff4b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:59.917663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1060db-04d5-4774-8a83-10041816ff4b None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:59.919075 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 426/841] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:17:59.924160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a47c-34f1-49fb-88f0-44bd2ec3a6f0 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:59.924557 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a47c-34f1-49fb-88f0-44bd2ec3a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:59.924727 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a47c-34f1-49fb-88f0-44bd2ec3a6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:59.943207 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f150a47c-34f1-49fb-88f0-44bd2ec3a6f0 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:17:59.944516 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f150a47c-34f1-49fb-88f0-44bd2ec3a6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:00.020665 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 416/842] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:17:59 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:18:00.352308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1060db-04d5-4774-8a83-10041816ff4b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:00.466020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1060db-04d5-4774-8a83-10041816ff4b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:00.504702 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27db4-d241-4f49-b493-821b1ccdf481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:00.505454 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27db4-d241-4f49-b493-821b1ccdf481 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:00.505798 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27db4-d241-4f49-b493-821b1ccdf481 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:00.506290 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27db4-d241-4f49-b493-821b1ccdf481 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:00.517417 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e27db4-d241-4f49-b493-821b1ccdf481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-52e27db4-d241-4f49-b493-821b1ccdf481 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:18:00.522258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:00.523306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:00.524736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 427/843] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:18:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:00.531069 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150a47c-34f1-49fb-88f0-44bd2ec3a6f0 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:00.646265 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150a47c-34f1-49fb-88f0-44bd2ec3a6f0 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:00.671793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:00.683896 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:00.684452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:00.684716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:00.685028 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:00.685689 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] RBAC: Adding query filter params (name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:00.685949 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:00.687310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:00.700836 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 417/844] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:18:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:00.702105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27db4-d241-4f49-b493-821b1ccdf481 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:00.745248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:00.812726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27db4-d241-4f49-b493-821b1ccdf481 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:00.850000 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:00.850619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:00.850922 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:00.851159 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:00.864185 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:00.865815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:00.881910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:00.883074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:00.884701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:00.884701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:00.884701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:00.886109 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 428/845] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:00.892052 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:00.997069 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb540e2-cab2-4d0f-bec9-26d6fe0c6d35 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:01.036204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:01.037086 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:01.037452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:01.037830 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:01.038736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:01.039134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:01.041740 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:01.058315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 418/846] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:01.064472 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:01.161284 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:01.172708 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b671d5-13c3-44e1-a4f1-32b25c92c4a3 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:01.220473 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:01.221262 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:01.221641 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:01.221990 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:01.233186 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:01.234675 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:18:01.246797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:01.247877 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:01.249349 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 429/847] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:01.253834 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:01.303468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:01.361543 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a40738-1457-4940-80a5-c9163eb2cb97 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:01.400936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:01.401544 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:01.401820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:01.402090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:01.402815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:01.403121 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:01.404670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:01.423332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 419/848] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 00:18:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:01.429343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:01.556582 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87cdfe-b935-4b05-84ee-571f494f3560 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:01.595159 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:01.595541 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:01.595928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:01.596142 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:01.609051 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:01.610532 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:01.631248 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:01.632689 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:01.634392 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:01.634392 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:01.634392 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:01.636660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 430/849] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:18:01.642014 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:01.768530 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e060-abda-40aa-9064-120b21985725 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:01.771810 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:01.810894 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:01.811434 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:01.811796 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:01.812102 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:01.812760 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:01.813059 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:01.814812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:01.830109 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 420/850] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:18:01.835988 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:01.839723 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:01.957764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51516a20-d9ff-40a7-993b-92704b896334 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:01.997195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:01.997948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:01.998231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:01.998507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:02.005134 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:02.006686 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:18:02.019476 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:02.020676 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:02.021566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 431/851] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:02.027897 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:02.141044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c5264-daa3-4e14-aded-a230eeaef0ce None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:02.179268 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fc3df-af41-49f2-ba0e-180def5118d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:02.179899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fc3df-af41-49f2-ba0e-180def5118d8 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:02.180176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fc3df-af41-49f2-ba0e-180def5118d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:02.180526 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fc3df-af41-49f2-ba0e-180def5118d8 None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:02.181307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fc3df-af41-49f2-ba0e-180def5118d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:02.181610 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fc3df-af41-49f2-ba0e-180def5118d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:02.183022 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fc3df-af41-49f2-ba0e-180def5118d8 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:02.197058 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 421/852] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:02.204203 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:02.272756 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:02.315247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20358b5b-58fb-4951-bb59-1bf3f156c84f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:02.351588 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9001c6-6f69-4d70-b9f0-c2f7f4eca311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:02.352298 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9001c6-6f69-4d70-b9f0-c2f7f4eca311 None admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:02.352578 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9001c6-6f69-4d70-b9f0-c2f7f4eca311 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:02.352962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9001c6-6f69-4d70-b9f0-c2f7f4eca311 None admin] PATH_INFO: `/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/16dbddc103734eae8a975b8940d84394/roles/1c927c2c8e3e4083a5617863d2d3e08f` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:02.368943 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9001c6-6f69-4d70-b9f0-c2f7f4eca311 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ee46bb5a5b04e239bf1ef96355c8080, user_id=16dbddc103734eae8a975b8940d84394, role_id=1c927c2c8e3e4083a5617863d2d3e08f)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:02.370544 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9001c6-6f69-4d70-b9f0-c2f7f4eca311 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:02.384359 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 432/853] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:18:02 2022] PUT /identity/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/16dbddc103734eae8a975b8940d84394/roles/1c927c2c8e3e4083a5617863d2d3e08f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:18:04.588114 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c158e4-c914-4d55-9408-d038e2cfd658 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:04.588667 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c158e4-c914-4d55-9408-d038e2cfd658 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:04.588831 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c158e4-c914-4d55-9408-d038e2cfd658 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:04.590184 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 422/854] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:04.595702 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13ac3-d4b1-4b56-a0c4-381d053f71f2 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:04.596260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13ac3-d4b1-4b56-a0c4-381d053f71f2 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:04.596406 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13ac3-d4b1-4b56-a0c4-381d053f71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:04.615531 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-27f13ac3-d4b1-4b56-a0c4-381d053f71f2 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:04.617058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-27f13ac3-d4b1-4b56-a0c4-381d053f71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:04.692588 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 433/855] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:04 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:18:05.063236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c158e4-c914-4d55-9408-d038e2cfd658 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:05.092909 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:05.186260 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c158e4-c914-4d55-9408-d038e2cfd658 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:05.225594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f6aff-da68-438f-906d-e4094672ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:05.226218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f6aff-da68-438f-906d-e4094672ce8f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.226509 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f6aff-da68-438f-906d-e4094672ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.226782 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f6aff-da68-438f-906d-e4094672ce8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.237630 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f6aff-da68-438f-906d-e4094672ce8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-636f6aff-da68-438f-906d-e4094672ce8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:18:05.242295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:05.244021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:05.245045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 423/856] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 00:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:05.251094 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f13ac3-d4b1-4b56-a0c4-381d053f71f2 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:05.297626 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:05.366540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f13ac3-d4b1-4b56-a0c4-381d053f71f2 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:05.405002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:05.405602 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.405876 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.406140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.406788 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] RBAC: Adding query filter params (name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:05.407084 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:05.408498 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:05.417226 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 434/857] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 00:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:05.423337 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f6aff-da68-438f-906d-e4094672ce8f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:05.530504 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:05.547666 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f6aff-da68-438f-906d-e4094672ce8f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:05.589956 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:05.590678 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.590877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.591156 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.602943 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:05.605325 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:05.622659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:05.623904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:05.624987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:05.624987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:05.624987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:05.624987 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 424/858] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:05.631239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:05.745869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c63d2d-4b71-45a6-8d29-648283d40e3b None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:05.748233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:05.784739 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:05.785338 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.785617 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.785882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.786521 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:05.786821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:05.788234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:05.801866 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 435/859] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:05.807777 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:05.923463 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384573d8-9dd3-4815-abaa-34d643a1b82f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:05.966251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:05.966888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.967199 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.967503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.970545 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:05.977327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:05.979101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:18:05.992424 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:05.993574 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:05.994704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 425/860] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:06.000654 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:06.118757 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44440cf-9c86-4968-aa03-03e8f3d4072c None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:06.158069 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:06.158682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:06.158962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:06.159282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:06.160095 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:06.160417 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:06.162075 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:06.181025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 436/861] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 00:18:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:06.186992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:06.302067 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378550a-881a-4413-9c0f-b2d07a6c5f86 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:06.338944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56b7fe-8497-47c7-a922-1affb3fb339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:06.339676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56b7fe-8497-47c7-a922-1affb3fb339e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:06.339996 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56b7fe-8497-47c7-a922-1affb3fb339e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:06.340318 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56b7fe-8497-47c7-a922-1affb3fb339e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:06.406624 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:06.414235 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56b7fe-8497-47c7-a922-1affb3fb339e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:06.416191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56b7fe-8497-47c7-a922-1affb3fb339e None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:06.538678 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 426/862] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:18:06 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:18:06.546049 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:06.572635 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:06.659194 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971479-dd4a-459e-89c2-6697d13ec17f None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:06.694923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:06.695559 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:06.696383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:06.696664 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:06.707471 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:06.709123 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:06.725839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:06.732649 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:06.733764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:06.733764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:06.733764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:06.733764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 437/863] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:06.734056 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56b7fe-8497-47c7-a922-1affb3fb339e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:06.838928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:06.845301 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56b7fe-8497-47c7-a922-1affb3fb339e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:06.885430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:06.886045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:06.886345 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:06.886685 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:06.887335 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:06.887645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:06.889117 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:06.902833 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 427/864] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:06.909447 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:06.990614 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:07.026746 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443b3b-d3ba-4ce2-980c-73efb3335d45 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:07.069604 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:07.070320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:07.070638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:07.070948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:07.078305 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:07.079796 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:18:07.091960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:07.099565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:07.100886 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 438/865] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:07.101810 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:07.209928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038a7f9-4269-4516-ba9d-658aede1e701 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:07.248547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2048b6b-9850-4164-93ff-68e4e9839605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:07.249074 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048b6b-9850-4164-93ff-68e4e9839605 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:07.249355 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048b6b-9850-4164-93ff-68e4e9839605 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:07.249622 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048b6b-9850-4164-93ff-68e4e9839605 None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:07.250310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2048b6b-9850-4164-93ff-68e4e9839605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:07.250613 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2048b6b-9850-4164-93ff-68e4e9839605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:07.252195 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2048b6b-9850-4164-93ff-68e4e9839605 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:07.264778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 428/866] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:07.271300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:07.389876 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cccec8-84a1-47ce-af54-22c6405221c3 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:07.428034 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfaacf-8575-4982-9ce9-460ae10a81b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:07.428779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfaacf-8575-4982-9ce9-460ae10a81b7 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:07.429091 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfaacf-8575-4982-9ce9-460ae10a81b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:07.429386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfaacf-8575-4982-9ce9-460ae10a81b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:07.430293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfaacf-8575-4982-9ce9-460ae10a81b7 None admin] RBAC: Adding query filter params (role.id=1c927c2c8e3e4083a5617863d2d3e08f, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=16dbddc103734eae8a975b8940d84394) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:07.430674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfaacf-8575-4982-9ce9-460ae10a81b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:07.432406 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfaacf-8575-4982-9ce9-460ae10a81b7 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:07.434382 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:07.439383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 439/867] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:18:07 2022] GET /identity/v3/role_assignments?user.id=16dbddc103734eae8a975b8940d84394&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=1c927c2c8e3e4083a5617863d2d3e08f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:09.819605 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a81a6-9956-4a05-8e12-6e038b59dde2 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:09.820236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a81a6-9956-4a05-8e12-6e038b59dde2 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:09.820236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a81a6-9956-4a05-8e12-6e038b59dde2 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:09.822529 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 429/868] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:09.828332 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3adb-149d-49ab-9f2d-c9901a2742dc None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:09.828864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3adb-149d-49ab-9f2d-c9901a2742dc None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:09.829017 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3adb-149d-49ab-9f2d-c9901a2742dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:09.849482 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-329d3adb-149d-49ab-9f2d-c9901a2742dc None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:09.850858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-329d3adb-149d-49ab-9f2d-c9901a2742dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:09.924232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 440/869] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:09 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:18:10.261163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a81a6-9956-4a05-8e12-6e038b59dde2 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:10.281856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:10.372060 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a81a6-9956-4a05-8e12-6e038b59dde2 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:10.413579 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9cc77-c9d1-425d-a361-59eed48d4ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:10.414262 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9cc77-c9d1-425d-a361-59eed48d4ac2 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:10.414606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9cc77-c9d1-425d-a361-59eed48d4ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:10.414919 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9cc77-c9d1-425d-a361-59eed48d4ac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:10.425498 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9cc77-c9d1-425d-a361-59eed48d4ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-13c9cc77-c9d1-425d-a361-59eed48d4ac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:18:10.430205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:10.431319 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:10.432202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 430/870] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:10.438124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d3adb-149d-49ab-9f2d-c9901a2742dc None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:10.550151 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d3adb-149d-49ab-9f2d-c9901a2742dc None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:10.578485 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:10.587771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:10.588408 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:10.588681 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:10.588947 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:10.589598 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:10.589894 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:10.594571 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:10.610139 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 441/871] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:10.611402 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9cc77-c9d1-425d-a361-59eed48d4ac2 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:10.699341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:10.725607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9cc77-c9d1-425d-a361-59eed48d4ac2 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:10.764098 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:10.764720 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:10.764995 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:10.765258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:10.775847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:10.777573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:10.794079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:10.795247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:10.801618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:10.801618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:10.801618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:10.801618 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 431/872] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:10.802017 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:10.920372 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c1675-049d-431a-a0d0-f736f24a5118 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:10.957592 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:10.958202 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:10.958478 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:10.958744 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:10.959386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:10.959684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:10.961633 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:10.980425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 442/873] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:10.982131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:11.111392 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08235488-a495-4fdf-9313-cf7dd7b6dc25 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:11.140935 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:11.150080 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:11.150733 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:11.151006 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:11.151272 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:11.159617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:11.161099 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:18:11.173820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:11.175019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:11.176036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 432/874] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:11.181151 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:11.236265 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:11.289059 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f63a-1f92-46ec-99ff-6a3fede7fbef None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:11.325749 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:11.326367 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:11.326647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:11.326918 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:11.327659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:11.328003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:11.329465 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:11.352782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 443/875] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 00:18:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:11.354711 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:11.470582 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe769a-90ef-4605-9188-4716793971ca None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:11.505713 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce7ae3-1a52-4215-a463-69747d6108c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:11.506314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7ae3-1a52-4215-a463-69747d6108c4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:11.506595 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7ae3-1a52-4215-a463-69747d6108c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:11.506869 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7ae3-1a52-4215-a463-69747d6108c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:11.564566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:11.577415 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce7ae3-1a52-4215-a463-69747d6108c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:11.578873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce7ae3-1a52-4215-a463-69747d6108c4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:11.682450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 433/876] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:18:11 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:18:11.688409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:11.785557 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36928a-bf32-46bb-8367-b8f85c6e8382 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:11.795451 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:11.819583 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:11.820234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:11.821032 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:11.821303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:11.831107 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:11.832646 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:11.848320 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:11.849397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:11.850478 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:11.850478 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:11.850478 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:11.850478 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 444/877] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:11.855406 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce7ae3-1a52-4215-a463-69747d6108c4 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:11.941123 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:11.953814 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce7ae3-1a52-4215-a463-69747d6108c4 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:11.986647 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:11.987221 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:11.987498 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:11.987769 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:11.988427 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:11.988726 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:11.990077 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:12.000999 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 434/878] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:12.006655 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:12.112389 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa2bc-365d-4152-8d98-7755d5fa8890 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:12.152954 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:12.153576 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:12.153856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:12.154127 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] PATH_INFO: `/v3/projects/service` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:12.160549 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:12.161990 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:18:12.173388 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:12.174400 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:12.175619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 445/879] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:12.181037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:12.278059 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb146c-7fab-404e-8858-ac26a9efeb09 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:12.310518 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7787052-239a-4941-9511-bc6a4fbb4e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:12.311102 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7787052-239a-4941-9511-bc6a4fbb4e6b None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:12.311377 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7787052-239a-4941-9511-bc6a4fbb4e6b None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:12.311650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7787052-239a-4941-9511-bc6a4fbb4e6b None admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:12.312383 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7787052-239a-4941-9511-bc6a4fbb4e6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:12.312689 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7787052-239a-4941-9511-bc6a4fbb4e6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:12.314098 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7787052-239a-4941-9511-bc6a4fbb4e6b None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:12.326278 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 435/880] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:18:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:12.332309 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:12.353969 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:12.441389 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b19f9-2a54-4a91-aaae-7214da14627d None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:12.476262 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39020-2388-4672-be3e-d36584d005aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:12.477357 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39020-2388-4672-be3e-d36584d005aa None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:12.477629 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39020-2388-4672-be3e-d36584d005aa None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:12.477901 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39020-2388-4672-be3e-d36584d005aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:12.478614 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39020-2388-4672-be3e-d36584d005aa None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=16dbddc103734eae8a975b8940d84394) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:12.478916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39020-2388-4672-be3e-d36584d005aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:12.480373 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39020-2388-4672-be3e-d36584d005aa None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:12.485691 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 446/881] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:18:12 2022] GET /identity/v3/role_assignments?user.id=16dbddc103734eae8a975b8940d84394&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=952eea31fada4104858d315ac0f1296a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:14.656729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db9b7d-0f52-490e-a241-8eb402dd5f43 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:14.657246 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db9b7d-0f52-490e-a241-8eb402dd5f43 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:14.657246 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db9b7d-0f52-490e-a241-8eb402dd5f43 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:14.658605 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 436/882] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:14.663629 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a0dd-8af7-4bf7-b34d-0cd734fa662e None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:14.664768 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a0dd-8af7-4bf7-b34d-0cd734fa662e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:14.665051 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a0dd-8af7-4bf7-b34d-0cd734fa662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:14.683720 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-6f46a0dd-8af7-4bf7-b34d-0cd734fa662e None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:14.684941 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-6f46a0dd-8af7-4bf7-b34d-0cd734fa662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:14.749507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 447/883] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:14 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:18:15.089502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db9b7d-0f52-490e-a241-8eb402dd5f43 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:15.102783 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:15.197344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db9b7d-0f52-490e-a241-8eb402dd5f43 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:15.229640 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c050c1-0dca-47c9-bc20-76027eeff36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:15.230250 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c050c1-0dca-47c9-bc20-76027eeff36e None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:15.230528 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c050c1-0dca-47c9-bc20-76027eeff36e None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:15.230800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c050c1-0dca-47c9-bc20-76027eeff36e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:15.240815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c050c1-0dca-47c9-bc20-76027eeff36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-33c050c1-0dca-47c9-bc20-76027eeff36e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:18:15.246180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:15.247191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:15.248046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 437/884] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:18:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:15.253536 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a0dd-8af7-4bf7-b34d-0cd734fa662e None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:15.269159 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:15.351391 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a0dd-8af7-4bf7-b34d-0cd734fa662e None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:15.385109 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:15.385710 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:15.385987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:15.386255 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:15.386905 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:15.387203 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:15.388605 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:15.396374 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 448/885] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:18:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:15.402075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c050c1-0dca-47c9-bc20-76027eeff36e None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:15.467604 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:15.500772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c050c1-0dca-47c9-bc20-76027eeff36e None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:15.534389 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:15.535010 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:15.535291 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:15.535568 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:15.546328 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:15.547767 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:15.562050 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:15.563240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:15.564491 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:15.564491 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:15.564491 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:15.564491 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 438/886] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:15.568988 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:15.645662 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:15.670022 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a9ca1-0a41-48fe-b65c-d4321ec27831 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:15.704732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:15.705327 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:15.705601 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:15.705867 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:15.706498 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:15.706793 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:15.708178 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:15.720236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 449/887] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:15.726092 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:15.826525 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cddc69-1502-4689-a2fd-7e86ee761b07 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:15.846243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:15.860967 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:15.861579 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:15.861856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:15.862121 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] PATH_INFO: `/v3/users/placement` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:15.870232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:15.871645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:18:15.882256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:15.883590 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:15.889524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 439/888] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:15.890225 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:15.986813 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee058d87-fc71-4513-b25c-03d000cb7e4a None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:16.022732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:16.024071 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:16.024299 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:16.024611 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:16.025517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:16.025923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:16.027782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:16.031264 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:16.048470 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 450/889] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 00:18:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:16.054302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:16.153139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6deeea-9c36-4ff5-905c-9d7449a3c25f None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:16.186183 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:16.186792 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:16.187072 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:16.187346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:16.197689 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:16.199130 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:16.213523 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:16.214599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:16.215513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:16.215513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:16.215513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:16.215513 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 440/890] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:16.220427 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:16.318018 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483b6fb-b726-485f-87cc-d11b3497b0e7 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:16.352008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:16.352603 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:16.352883 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:16.353155 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:16.353789 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:16.354088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:16.355451 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:16.366274 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 451/891] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:16.372297 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:16.405855 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:16.475314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff1282-f720-41d6-83f1-f5c73bf05374 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:16.508765 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:16.509387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:16.509664 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:16.509932 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:16.516388 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:16.517823 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:18:16.529872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:16.530890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:16.531908 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 441/892] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:16.536767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:16.591914 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:16.635674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032001-721b-4b8b-9551-947f158ad2ca None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:16.668953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3c571-2b18-48cb-beab-aa88538104a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:16.669542 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3c571-2b18-48cb-beab-aa88538104a3 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:16.669821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3c571-2b18-48cb-beab-aa88538104a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:16.670092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3c571-2b18-48cb-beab-aa88538104a3 None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:16.670784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3c571-2b18-48cb-beab-aa88538104a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:16.671087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3c571-2b18-48cb-beab-aa88538104a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:16.672539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3c571-2b18-48cb-beab-aa88538104a3 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:16.684546 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 452/893] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:16.690613 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:16.780451 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:16.789781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70a523-c591-4a8d-8d0f-a1cfab65de60 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:16.823851 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717bbb0-cf96-4f67-aa33-c554d9591373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:16.824518 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717bbb0-cf96-4f67-aa33-c554d9591373 None admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:16.824795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717bbb0-cf96-4f67-aa33-c554d9591373 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:16.825067 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717bbb0-cf96-4f67-aa33-c554d9591373 None admin] PATH_INFO: `/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/16dbddc103734eae8a975b8940d84394/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:16.826957 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717bbb0-cf96-4f67-aa33-c554d9591373 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ee46bb5a5b04e239bf1ef96355c8080, user_id=16dbddc103734eae8a975b8940d84394, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:16.828417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717bbb0-cf96-4f67-aa33-c554d9591373 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:16.840889 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 442/894] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 00:18:16 2022] PUT /identity/v3/projects/9ee46bb5a5b04e239bf1ef96355c8080/users/16dbddc103734eae8a975b8940d84394/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:18:19.019656 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952038-b819-41c6-b645-8640b6f42e14 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:19.020343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952038-b819-41c6-b645-8640b6f42e14 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:19.020343 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952038-b819-41c6-b645-8640b6f42e14 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:19.021536 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 453/895] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:19.029089 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9499a8-5438-49fe-8174-a2e22bef74c0 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:19.029872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9499a8-5438-49fe-8174-a2e22bef74c0 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:19.030083 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9499a8-5438-49fe-8174-a2e22bef74c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:19.057875 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-6b9499a8-5438-49fe-8174-a2e22bef74c0 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:19.059130 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-6b9499a8-5438-49fe-8174-a2e22bef74c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:19.132112 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 443/896] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:19 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:18:19.462038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae952038-b819-41c6-b645-8640b6f42e14 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:19.562972 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae952038-b819-41c6-b645-8640b6f42e14 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:19.576566 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:19.596539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192d162-edc8-4013-be43-6108d83f25c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:19.597182 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d162-edc8-4013-be43-6108d83f25c9 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:19.597464 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d162-edc8-4013-be43-6108d83f25c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:19.597736 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d162-edc8-4013-be43-6108d83f25c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:19.608054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192d162-edc8-4013-be43-6108d83f25c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-f192d162-edc8-4013-be43-6108d83f25c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:18:19.612705 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:19.613764 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:19.614928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 454/897] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 00:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:18:19.620400 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9499a8-5438-49fe-8174-a2e22bef74c0 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:19.702206 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:19.728787 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9499a8-5438-49fe-8174-a2e22bef74c0 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:19.761742 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:19.762337 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:19.762616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:19.762888 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:19.763545 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:19.763877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:19.765252 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:19.773569 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 444/898] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 00:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:19.779408 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192d162-edc8-4013-be43-6108d83f25c9 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:19.879184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192d162-edc8-4013-be43-6108d83f25c9 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:19.912780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:19.913398 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:19.913714 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:19.913981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:19.923960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:19.925383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:19.939645 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:19.940783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:19.941862 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:19.941862 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:19.941862 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:19.941862 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 455/899] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:19.947187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:20.052874 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299ad8-9d44-4ec1-9159-d7a09deaa179 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:20.085949 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:20.086540 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:20.086819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:20.087091 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:20.087726 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:20.088077 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:20.089430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:20.100675 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 445/900] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:20.107059 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:20.134833 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:20.206820 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74eab-c85b-4cdf-aabb-7946449a5f48 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:20.239616 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:20.240260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:20.240536 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:20.240807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:20.248580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:20.250020 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:18:20.260938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:20.262019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:20.263135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 456/901] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:20.267812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:20.271549 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:20.365750 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b09aa-5f5f-49ee-bd7c-afbd73d465d5 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:20.398755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:20.399353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:20.399638 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:20.399945 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:20.400668 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:20.400978 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:20.402396 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:20.419801 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 446/902] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 00:18:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:20.425635 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:20.517121 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:20.532846 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045b11e-2568-4fab-bf40-32e1336ade05 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:20.565606 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061684-69a0-4af4-8685-e14c22b08206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:20.566195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061684-69a0-4af4-8685-e14c22b08206 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:20.566495 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061684-69a0-4af4-8685-e14c22b08206 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:20.566761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061684-69a0-4af4-8685-e14c22b08206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:20.631856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061684-69a0-4af4-8685-e14c22b08206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:20.633299 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061684-69a0-4af4-8685-e14c22b08206 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:20.713360 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:20.729300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 457/903] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 00:18:20 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:18:20.735921 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:20.796844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:20.837440 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ee91-5067-435a-8e1e-23542ece16a4 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:20.870090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:20.870702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:20.870978 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:20.871249 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:20.880984 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:20.882992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:18:20.896880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:20.898586 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:18:20.900040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:18:20.900040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:18:20.900040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:20.900040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 447/904] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:20.905714 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061684-69a0-4af4-8685-e14c22b08206 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:21.001234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061684-69a0-4af4-8685-e14c22b08206 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:21.036607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:21.037204 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:21.037487 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:21.037757 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:21.038419 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:21.038746 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:21.040390 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:21.051219 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 458/905] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 00:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:21.057166 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:21.161984 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062bc1e-569a-484e-98f0-9a31ebebaa71 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:21.175164 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:21.196283 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:21.196898 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:21.197172 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:21.197443 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:21.203954 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:21.205373 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:18:21.216118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:21.217119 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: ERROR keystone.server.flask.application Aug 24 00:18:21.223430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 448/906] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 00:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:21.224068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:21.270084 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:21.323455 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34765aa5-22ff-47fd-b324-aa66e68daa26 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:21.355682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c79cd-f212-474e-8ba3-c9cbd8c8589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:21.356303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c79cd-f212-474e-8ba3-c9cbd8c8589f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:21.356586 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c79cd-f212-474e-8ba3-c9cbd8c8589f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:21.356859 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c79cd-f212-474e-8ba3-c9cbd8c8589f None admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:21.357543 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c79cd-f212-474e-8ba3-c9cbd8c8589f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:21.357848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c79cd-f212-474e-8ba3-c9cbd8c8589f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:21.359278 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c79cd-f212-474e-8ba3-c9cbd8c8589f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:21.371414 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 459/907] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 00:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:18:21.377596 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:21.481729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6423-5b81-4fe8-b63f-2cfaea621f46 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:21.514891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e27c5-1dfa-4382-8055-61f40e7898b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:21.515534 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e27c5-1dfa-4382-8055-61f40e7898b3 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:21.515891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e27c5-1dfa-4382-8055-61f40e7898b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:21.516220 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e27c5-1dfa-4382-8055-61f40e7898b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:21.516989 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e27c5-1dfa-4382-8055-61f40e7898b3 None admin] RBAC: Adding query filter params (role.id=952eea31fada4104858d315ac0f1296a, scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080, user.id=16dbddc103734eae8a975b8940d84394) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:21.517342 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e27c5-1dfa-4382-8055-61f40e7898b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:21.518817 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e27c5-1dfa-4382-8055-61f40e7898b3 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:21.525123 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 449/908] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 00:18:21 2022] GET /identity/v3/role_assignments?user.id=16dbddc103734eae8a975b8940d84394&scope.project.id=9ee46bb5a5b04e239bf1ef96355c8080&role.id=952eea31fada4104858d315ac0f1296a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:23.705153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657314-ba1f-461d-93a1-1b45d29a3ceb None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:23.705690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657314-ba1f-461d-93a1-1b45d29a3ceb None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:23.705690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657314-ba1f-461d-93a1-1b45d29a3ceb None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:23.707053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 460/909] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:23.712556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df28afb-fe98-493d-b9fc-bf499a885878 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:23.712943 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df28afb-fe98-493d-b9fc-bf499a885878 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:23.713098 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df28afb-fe98-493d-b9fc-bf499a885878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:23.730817 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-3df28afb-fe98-493d-b9fc-bf499a885878 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:23.731959 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-3df28afb-fe98-493d-b9fc-bf499a885878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:23.763971 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:23.801828 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 450/910] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:23 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:18:24.140610 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657314-ba1f-461d-93a1-1b45d29a3ceb None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:24.242846 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657314-ba1f-461d-93a1-1b45d29a3ceb None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:24.249951 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:24.276771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:24.277385 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:24.277662 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:24.277930 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:24.278497 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:24.279882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:24.288322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:24.290384 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:24.291280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 461/911] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 24 00:18:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:24.296380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df28afb-fe98-493d-b9fc-bf499a885878 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:24.391912 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df28afb-fe98-493d-b9fc-bf499a885878 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:24.425835 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe2992-712c-4a35-a121-e201ba417554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:24.426431 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2992-712c-4a35-a121-e201ba417554 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:24.426714 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2992-712c-4a35-a121-e201ba417554 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:24.426990 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2992-712c-4a35-a121-e201ba417554 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:24.427609 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe2992-712c-4a35-a121-e201ba417554 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:24.427944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe2992-712c-4a35-a121-e201ba417554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:24.429536 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe2992-712c-4a35-a121-e201ba417554 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:24.434154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 451/912] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 24 00:18:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:24.440037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:24.551538 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4c8ec-9838-4e85-97da-2381f5376286 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:24.584608 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632aef1-c39a-482b-ae07-128a8d9f93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:24.585213 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632aef1-c39a-482b-ae07-128a8d9f93e8 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:24.586102 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632aef1-c39a-482b-ae07-128a8d9f93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:24.586379 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632aef1-c39a-482b-ae07-128a8d9f93e8 None admin] PATH_INFO: `/v3/services` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:24.586996 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632aef1-c39a-482b-ae07-128a8d9f93e8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:24.587299 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632aef1-c39a-482b-ae07-128a8d9f93e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:24.588692 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632aef1-c39a-482b-ae07-128a8d9f93e8 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:24.592984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 462/913] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 24 00:18:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:26.767221 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de37d10-4a9e-47e4-aa73-fd94e2459c8e None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:26.767781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de37d10-4a9e-47e4-aa73-fd94e2459c8e None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:26.767781 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de37d10-4a9e-47e4-aa73-fd94e2459c8e None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:26.769222 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 452/914] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:26.775056 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de967-baf8-4dff-8521-b282af0373a5 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:26.775466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de967-baf8-4dff-8521-b282af0373a5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:26.775606 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de967-baf8-4dff-8521-b282af0373a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:26.795239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e45de967-baf8-4dff-8521-b282af0373a5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:26.796473 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e45de967-baf8-4dff-8521-b282af0373a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:26.823861 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:26.864680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 463/915] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:26 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:18:27.217148 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de37d10-4a9e-47e4-aa73-fd94e2459c8e None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:27.248920 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:27.319575 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de37d10-4a9e-47e4-aa73-fd94e2459c8e None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:27.352882 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c9957-5d4b-4f41-9e42-9924987c5b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:27.353475 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c9957-5d4b-4f41-9e42-9924987c5b60 None admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:27.353756 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c9957-5d4b-4f41-9e42-9924987c5b60 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:27.354030 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c9957-5d4b-4f41-9e42-9924987c5b60 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:27.354663 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c9957-5d4b-4f41-9e42-9924987c5b60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:27.356044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c9957-5d4b-4f41-9e42-9924987c5b60 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:27.371619 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 453/916] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 00:18:27 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:18:29.592106 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424c475-9dd3-4fef-b3f4-4f81848e8a3b None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:29.592730 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424c475-9dd3-4fef-b3f4-4f81848e8a3b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:29.592730 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424c475-9dd3-4fef-b3f4-4f81848e8a3b None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:29.594081 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 464/917] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:29.599262 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ebb4b-0149-4446-b15b-6d7451cd07a5 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:29.599670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ebb4b-0149-4446-b15b-6d7451cd07a5 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:29.599812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ebb4b-0149-4446-b15b-6d7451cd07a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:29.618156 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-b65ebb4b-0149-4446-b15b-6d7451cd07a5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:29.619332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-b65ebb4b-0149-4446-b15b-6d7451cd07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:29.690284 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 454/918] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:29 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:18:30.029058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424c475-9dd3-4fef-b3f4-4f81848e8a3b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:30.136834 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424c475-9dd3-4fef-b3f4-4f81848e8a3b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:30.170148 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:30.170767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:30.171044 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:30.171314 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:30.171931 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:30.173298 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:30.182288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:30.183449 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:30.184712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 465/919] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 24 00:18:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:18:30.189449 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ebb4b-0149-4446-b15b-6d7451cd07a5 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:30.208191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:30.291035 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ebb4b-0149-4446-b15b-6d7451cd07a5 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:30.324019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:30.324606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:30.324880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:30.325145 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:30.325760 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:30.326053 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:30.327387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:30.333066 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 455/920] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 24 00:18:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:30.339070 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:30.368699 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:30.439685 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da276d8-4024-431f-b07c-dbc673d52912 None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:30.472635 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3be06-e92e-4c9c-b36f-de6cf3c4da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:30.473234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3be06-e92e-4c9c-b36f-de6cf3c4da9f None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:30.473507 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3be06-e92e-4c9c-b36f-de6cf3c4da9f None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:30.473773 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3be06-e92e-4c9c-b36f-de6cf3c4da9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:30.474468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3be06-e92e-4c9c-b36f-de6cf3c4da9f None admin] RBAC: Adding query filter params (interface=public, service_id=6171e46d2ccd486aa90dca04861f72e3, region_id=RegionOne) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:30.474770 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3be06-e92e-4c9c-b36f-de6cf3c4da9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:30.476229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3be06-e92e-4c9c-b36f-de6cf3c4da9f None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:30.481563 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 466/921] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 00:18:30 2022] GET /identity/v3/endpoints?service_id=6171e46d2ccd486aa90dca04861f72e3&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:30.487349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:30.568517 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:30.588120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4abe-5a91-4f31-9241-d698393a1175 None admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:30.621741 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44973201-2f08-428a-b61d-e4a8f9bb170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:30.622331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973201-2f08-428a-b61d-e4a8f9bb170d None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:30.622591 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973201-2f08-428a-b61d-e4a8f9bb170d None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:30.622859 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973201-2f08-428a-b61d-e4a8f9bb170d None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:30.623450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44973201-2f08-428a-b61d-e4a8f9bb170d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:30.624905 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44973201-2f08-428a-b61d-e4a8f9bb170d None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:30.631171 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 456/922] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 00:18:30 2022] GET /identity/v3/services => generated 1962 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:18:32.814307 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9172a9-4b95-49eb-ba82-491a06e8979c None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:32.814873 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9172a9-4b95-49eb-ba82-491a06e8979c None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:32.814873 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9172a9-4b95-49eb-ba82-491a06e8979c None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:32.816229 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 467/923] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:32.822056 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294211-e7f9-46a5-be9f-61c04cbb17ef None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:32.822489 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294211-e7f9-46a5-be9f-61c04cbb17ef None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:32.822588 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294211-e7f9-46a5-be9f-61c04cbb17ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:32.840868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-3f294211-e7f9-46a5-be9f-61c04cbb17ef None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:32.842039 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-3f294211-e7f9-46a5-be9f-61c04cbb17ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:32.906230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 457/924] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:32 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:18:33.233522 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9172a9-4b95-49eb-ba82-491a06e8979c None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:33.325977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:33.336220 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9172a9-4b95-49eb-ba82-491a06e8979c None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:33.369532 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:33.370152 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:33.370430 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:33.370700 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] PATH_INFO: `/v3/services/placement` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:33.371274 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:33.372680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:18:33.381210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:18:33.382428 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application with Lock( Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: ERROR keystone.server.flask.application Aug 24 00:18:33.384308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 468/925] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 24 00:18:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:18:33.388833 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f294211-e7f9-46a5-be9f-61c04cbb17ef None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:33.463564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:33.488134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f294211-e7f9-46a5-be9f-61c04cbb17ef None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:33.520710 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdd97c-b133-4ce6-aa08-16462f8735ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:33.521298 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdd97c-b133-4ce6-aa08-16462f8735ce None admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:33.521573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdd97c-b133-4ce6-aa08-16462f8735ce None admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:33.521843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdd97c-b133-4ce6-aa08-16462f8735ce None admin] PATH_INFO: `/v3/services` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:33.522456 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdd97c-b133-4ce6-aa08-16462f8735ce None admin] RBAC: Adding query filter params (name=placement) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:18:33.522754 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdd97c-b133-4ce6-aa08-16462f8735ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:33.524676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdd97c-b133-4ce6-aa08-16462f8735ce None admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:33.529502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 458/926] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 24 00:18:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:18:33.535303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:33.634573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114c877-a701-46c3-9013-8911d8463bef None admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:33.667501 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544b975-2f18-4a94-ab67-0ba3c4f0a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:33.668129 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b975-2f18-4a94-ab67-0ba3c4f0a62a None admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:33.668410 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b975-2f18-4a94-ab67-0ba3c4f0a62a None admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:33.668684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b975-2f18-4a94-ab67-0ba3c4f0a62a None admin] PATH_INFO: `/v3/endpoints` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:33.669327 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544b975-2f18-4a94-ab67-0ba3c4f0a62a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:33.670692 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544b975-2f18-4a94-ab67-0ba3c4f0a62a None admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:33.689665 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 469/927] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:18:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:18:43.526711 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=30 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:43.685797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:19:34.062350 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475872d-b517-49d1-ab2a-14087c334230 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:34.062925 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475872d-b517-49d1-ab2a-14087c334230 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:34.062925 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475872d-b517-49d1-ab2a-14087c334230 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:34.068294 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 459/928] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:34.069874 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921da973-deba-45ae-bf42-4dab04e1d67c None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:34.070728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921da973-deba-45ae-bf42-4dab04e1d67c None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:34.071213 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921da973-deba-45ae-bf42-4dab04e1d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:34.113873 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-921da973-deba-45ae-bf42-4dab04e1d67c None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:34.115259 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-921da973-deba-45ae-bf42-4dab04e1d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:34.235664 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 470/929] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:34.599503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb69c-b05c-4071-9ddb-37d78300cfff None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:34.599784 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb69c-b05c-4071-9ddb-37d78300cfff None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:34.600084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb69c-b05c-4071-9ddb-37d78300cfff None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:34.601420 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 460/930] 10.222.0.70 () {54 vars in 965 bytes} [Wed Aug 24 00:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:34.610222 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd5022-aa5a-4958-a9f3-94505419aebf None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:34.610222 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd5022-aa5a-4958-a9f3-94505419aebf None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:34.610222 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd5022-aa5a-4958-a9f3-94505419aebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:34.690247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-98fd5022-aa5a-4958-a9f3-94505419aebf None None] MFA Rules not processed for user `0c2c8ea12b814b0f9abaaa2a2b8cd3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:34.691600 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-98fd5022-aa5a-4958-a9f3-94505419aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:34.757084 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 471/931] 10.222.0.70 () {58 vars in 1062 bytes} [Wed Aug 24 00:19:34 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:34.766675 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbb69c-b05c-4071-9ddb-37d78300cfff None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:34.777265 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbb69c-b05c-4071-9ddb-37d78300cfff None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:34.780625 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d7a02-d8ab-4a70-8600-f57f75223da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:34.781214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7a02-d8ab-4a70-8600-f57f75223da6 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:34.781486 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7a02-d8ab-4a70-8600-f57f75223da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:34.781754 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7a02-d8ab-4a70-8600-f57f75223da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:34.790381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d7a02-d8ab-4a70-8600-f57f75223da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:34.791792 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d7a02-d8ab-4a70-8600-f57f75223da6 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:34.801734 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 461/932] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:37.292183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3708e-3845-458b-80d7-07a5e860a695 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:37.292713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3708e-3845-458b-80d7-07a5e860a695 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:37.292713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3708e-3845-458b-80d7-07a5e860a695 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:37.294311 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 472/933] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:37.299483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d07a6-619a-4cf4-a05a-bfa9743acffb None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:37.299960 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d07a6-619a-4cf4-a05a-bfa9743acffb None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:37.300063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d07a6-619a-4cf4-a05a-bfa9743acffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:37.319886 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-b08d07a6-619a-4cf4-a05a-bfa9743acffb None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:37.321088 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-b08d07a6-619a-4cf4-a05a-bfa9743acffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:37.329767 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 462/934] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:37.695559 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f288e-3c8f-40cd-ad4d-0152e9c9b8f5 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:37.695876 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f288e-3c8f-40cd-ad4d-0152e9c9b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:37.696670 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f288e-3c8f-40cd-ad4d-0152e9c9b8f5 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:37.698239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 473/935] 10.222.0.70 () {54 vars in 965 bytes} [Wed Aug 24 00:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:37.704774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95990-6b5e-4b56-9ad3-e62c989b78b7 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:37.705788 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95990-6b5e-4b56-9ad3-e62c989b78b7 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:37.705788 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95990-6b5e-4b56-9ad3-e62c989b78b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:37.726514 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f1d95990-6b5e-4b56-9ad3-e62c989b78b7 None None] MFA Rules not processed for user `0c2c8ea12b814b0f9abaaa2a2b8cd3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:37.728540 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f1d95990-6b5e-4b56-9ad3-e62c989b78b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:37.735306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 463/936] 10.222.0.70 () {58 vars in 1062 bytes} [Wed Aug 24 00:19:37 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:37.744402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f288e-3c8f-40cd-ad4d-0152e9c9b8f5 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:37.759780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f288e-3c8f-40cd-ad4d-0152e9c9b8f5 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:37.763468 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2887a8-0591-40ca-94ea-54f805d0115a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:37.764099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2887a8-0591-40ca-94ea-54f805d0115a service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:37.764376 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2887a8-0591-40ca-94ea-54f805d0115a service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:37.764644 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2887a8-0591-40ca-94ea-54f805d0115a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:37.775322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2887a8-0591-40ca-94ea-54f805d0115a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:37.777528 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2887a8-0591-40ca-94ea-54f805d0115a service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:37.788000 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 474/937] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:40.570230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab9601-8180-4306-8d34-459407aefb59 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:40.570772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab9601-8180-4306-8d34-459407aefb59 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:40.570772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab9601-8180-4306-8d34-459407aefb59 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:40.572939 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 464/938] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:40.578573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1756c5-a643-4bf3-9e4f-da359f271b9e None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:40.579081 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1756c5-a643-4bf3-9e4f-da359f271b9e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:40.579157 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1756c5-a643-4bf3-9e4f-da359f271b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:40.620294 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-9d1756c5-a643-4bf3-9e4f-da359f271b9e None None] MFA Rules not processed for user `c3a35815d3cd4180a8c9c6cf81caffcf`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:40.621513 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-9d1756c5-a643-4bf3-9e4f-da359f271b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:40.664630 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:19:40.695085 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 475/939] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:40 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:41.039672 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab9601-8180-4306-8d34-459407aefb59 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:41.053911 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab9601-8180-4306-8d34-459407aefb59 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:41.058101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648f4ac-57eb-4aaa-b68e-17ff3a6d84d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:41.058692 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f4ac-57eb-4aaa-b68e-17ff3a6d84d2 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:41.058967 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f4ac-57eb-4aaa-b68e-17ff3a6d84d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:41.059233 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f4ac-57eb-4aaa-b68e-17ff3a6d84d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:41.068695 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648f4ac-57eb-4aaa-b68e-17ff3a6d84d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:41.070125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648f4ac-57eb-4aaa-b68e-17ff3a6d84d2 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:41.093806 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 465/940] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:41 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:43.922960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b35a4-9328-42a2-97fd-28054d37f8a4 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:43.923488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b35a4-9328-42a2-97fd-28054d37f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:43.923488 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b35a4-9328-42a2-97fd-28054d37f8a4 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:43.924840 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 476/941] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:43.930069 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4938f-578e-4663-84b5-ffeec65854f3 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:43.930442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4938f-578e-4663-84b5-ffeec65854f3 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:43.930620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4938f-578e-4663-84b5-ffeec65854f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:43.949579 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-40b4938f-578e-4663-84b5-ffeec65854f3 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:43.950779 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-40b4938f-578e-4663-84b5-ffeec65854f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:44.023913 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 466/942] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:43 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:44.378565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b35a4-9328-42a2-97fd-28054d37f8a4 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:44.389741 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b35a4-9328-42a2-97fd-28054d37f8a4 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:44.393261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d20eb-0196-4f0d-b1fb-205ac17f3f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:44.393844 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d20eb-0196-4f0d-b1fb-205ac17f3f53 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:44.394127 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d20eb-0196-4f0d-b1fb-205ac17f3f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:44.394396 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d20eb-0196-4f0d-b1fb-205ac17f3f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:44.404027 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d20eb-0196-4f0d-b1fb-205ac17f3f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:44.405469 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d20eb-0196-4f0d-b1fb-205ac17f3f53 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:44.414621 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 477/943] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:44 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:47.266953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae775-b6fe-48ad-abfe-2b6114732c26 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:47.267539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae775-b6fe-48ad-abfe-2b6114732c26 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:47.267539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae775-b6fe-48ad-abfe-2b6114732c26 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:47.268937 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 467/944] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:47.274379 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1392e3-d16d-44d2-b79c-a993b03b3f75 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:47.275541 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1392e3-d16d-44d2-b79c-a993b03b3f75 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:47.275541 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1392e3-d16d-44d2-b79c-a993b03b3f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:47.298109 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-ac1392e3-d16d-44d2-b79c-a993b03b3f75 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:47.299306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-ac1392e3-d16d-44d2-b79c-a993b03b3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:47.307864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 478/945] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:47.742497 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bae775-b6fe-48ad-abfe-2b6114732c26 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:47.753615 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bae775-b6fe-48ad-abfe-2b6114732c26 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:47.757155 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d310de-9219-4c9a-acfd-ee9a8b18ce49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:47.757749 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d310de-9219-4c9a-acfd-ee9a8b18ce49 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:47.758025 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d310de-9219-4c9a-acfd-ee9a8b18ce49 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:47.758297 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d310de-9219-4c9a-acfd-ee9a8b18ce49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:47.769768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d310de-9219-4c9a-acfd-ee9a8b18ce49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:47.771231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d310de-9219-4c9a-acfd-ee9a8b18ce49 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:47.782182 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 468/946] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:19:50.103531 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272890b-eacc-4ba8-9452-0837c72c1a91 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:50.104099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272890b-eacc-4ba8-9452-0837c72c1a91 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:50.104099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272890b-eacc-4ba8-9452-0837c72c1a91 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:50.105429 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 479/947] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:50.110569 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eedd66-446f-4f18-b128-361fa23b1835 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:50.111061 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eedd66-446f-4f18-b128-361fa23b1835 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:50.111165 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eedd66-446f-4f18-b128-361fa23b1835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:50.129719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-21eedd66-446f-4f18-b128-361fa23b1835 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:50.130906 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-21eedd66-446f-4f18-b128-361fa23b1835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:50.139201 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 469/948] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:50.483322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272890b-eacc-4ba8-9452-0837c72c1a91 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:50.493923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272890b-eacc-4ba8-9452-0837c72c1a91 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:50.497491 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a6431-f8df-4519-a8ea-c3b469e25aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:50.498076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6431-f8df-4519-a8ea-c3b469e25aeb service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:50.498347 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6431-f8df-4519-a8ea-c3b469e25aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:50.498611 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6431-f8df-4519-a8ea-c3b469e25aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:50.507365 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a6431-f8df-4519-a8ea-c3b469e25aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:50.508817 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a6431-f8df-4519-a8ea-c3b469e25aeb service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:50.518530 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 480/949] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:52.767950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c441-a34e-432c-9730-38f64c8c0ed0 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:52.768502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c441-a34e-432c-9730-38f64c8c0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:52.768502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c441-a34e-432c-9730-38f64c8c0ed0 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:52.769838 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 470/950] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:52.775456 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689787-a5d1-4fab-9a4c-90a2848e3f96 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:52.775895 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689787-a5d1-4fab-9a4c-90a2848e3f96 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:52.776203 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689787-a5d1-4fab-9a4c-90a2848e3f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:52.795946 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-3e689787-a5d1-4fab-9a4c-90a2848e3f96 None None] MFA Rules not processed for user `c3a35815d3cd4180a8c9c6cf81caffcf`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:52.797130 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-3e689787-a5d1-4fab-9a4c-90a2848e3f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:52.804801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 481/951] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:52 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:53.142900 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c441-a34e-432c-9730-38f64c8c0ed0 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:53.154135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c441-a34e-432c-9730-38f64c8c0ed0 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:53.157576 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412f3a6-7ce8-461a-b9f7-518fc518ca3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:53.158163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f3a6-7ce8-461a-b9f7-518fc518ca3a service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:53.158439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f3a6-7ce8-461a-b9f7-518fc518ca3a service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:53.158708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f3a6-7ce8-461a-b9f7-518fc518ca3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:53.167703 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412f3a6-7ce8-461a-b9f7-518fc518ca3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:53.169162 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412f3a6-7ce8-461a-b9f7-518fc518ca3a service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:53.179064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 471/952] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:53 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:55.586183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed8e7b-7db2-4f43-a1e4-9333d909e4d5 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:55.586723 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed8e7b-7db2-4f43-a1e4-9333d909e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:55.586723 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed8e7b-7db2-4f43-a1e4-9333d909e4d5 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:55.588113 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 482/953] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:55.593432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57024c-885a-4c13-90b8-3ba0a1f6cf4b None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:55.593826 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57024c-885a-4c13-90b8-3ba0a1f6cf4b None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:55.593985 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57024c-885a-4c13-90b8-3ba0a1f6cf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:55.613589 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-0d57024c-885a-4c13-90b8-3ba0a1f6cf4b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:55.614790 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-0d57024c-885a-4c13-90b8-3ba0a1f6cf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:55.623516 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 472/954] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:19:55.965908 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed8e7b-7db2-4f43-a1e4-9333d909e4d5 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:55.976692 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed8e7b-7db2-4f43-a1e4-9333d909e4d5 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:55.980852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6164b-5ffc-4cad-a24f-4386f35fe82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:55.981437 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6164b-5ffc-4cad-a24f-4386f35fe82f service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:55.981712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6164b-5ffc-4cad-a24f-4386f35fe82f service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:55.981981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6164b-5ffc-4cad-a24f-4386f35fe82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:55.990927 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6164b-5ffc-4cad-a24f-4386f35fe82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:55.992391 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6164b-5ffc-4cad-a24f-4386f35fe82f service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:56.002172 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 483/955] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:58.268538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad872-2cfa-491c-b268-03edc9f1296c None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:58.269059 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad872-2cfa-491c-b268-03edc9f1296c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:58.269059 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad872-2cfa-491c-b268-03edc9f1296c None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:58.270330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 473/956] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:58.275458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3448b-f759-454e-926f-0c413cb55c8a None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:58.275962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3448b-f759-454e-926f-0c413cb55c8a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:58.276080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3448b-f759-454e-926f-0c413cb55c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:58.295436 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-6dd3448b-f759-454e-926f-0c413cb55c8a None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:58.296671 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-6dd3448b-f759-454e-926f-0c413cb55c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:58.304517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 484/957] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:58.665841 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad872-2cfa-491c-b268-03edc9f1296c None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:58.676738 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad872-2cfa-491c-b268-03edc9f1296c None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:58.680190 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c223a-3fda-4db4-983b-9f5b92ba8ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:58.680778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c223a-3fda-4db4-983b-9f5b92ba8ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:58.681674 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c223a-3fda-4db4-983b-9f5b92ba8ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:58.681955 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c223a-3fda-4db4-983b-9f5b92ba8ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:58.690942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c223a-3fda-4db4-983b-9f5b92ba8ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:58.692398 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c223a-3fda-4db4-983b-9f5b92ba8ff4 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:58.702826 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 474/958] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:01.260274 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38f0e-e2af-42d8-a7f2-13edca746d5c None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:01.260841 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38f0e-e2af-42d8-a7f2-13edca746d5c None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:01.260841 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38f0e-e2af-42d8-a7f2-13edca746d5c None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:01.262154 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 485/959] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:01.267504 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544c34-8775-4ae5-980b-abe8b0553475 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:01.267928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544c34-8775-4ae5-980b-abe8b0553475 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:01.268084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544c34-8775-4ae5-980b-abe8b0553475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:01.287330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-6e544c34-8775-4ae5-980b-abe8b0553475 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:01.288554 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-6e544c34-8775-4ae5-980b-abe8b0553475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:01.296623 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 475/960] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:01 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:01.644731 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38f0e-e2af-42d8-a7f2-13edca746d5c None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:01.655568 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38f0e-e2af-42d8-a7f2-13edca746d5c None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:01.659271 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a22b35-3fe7-41f9-8bdf-857ca0b87568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:01.659893 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a22b35-3fe7-41f9-8bdf-857ca0b87568 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:01.660175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a22b35-3fe7-41f9-8bdf-857ca0b87568 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:01.660445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a22b35-3fe7-41f9-8bdf-857ca0b87568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:01.670395 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a22b35-3fe7-41f9-8bdf-857ca0b87568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:01.671818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a22b35-3fe7-41f9-8bdf-857ca0b87568 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:01.682071 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 486/961] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:01 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:05.823673 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561070c-9766-42c1-9f9f-221266173de7 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:05.824387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561070c-9766-42c1-9f9f-221266173de7 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:05.824387 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561070c-9766-42c1-9f9f-221266173de7 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:05.825520 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 476/962] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:05.830806 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81f64-91f7-4441-8ef1-8ebf7a92b54b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:05.831256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81f64-91f7-4441-8ef1-8ebf7a92b54b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:05.831347 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81f64-91f7-4441-8ef1-8ebf7a92b54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:05.850430 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-64f81f64-91f7-4441-8ef1-8ebf7a92b54b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:05.851607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-64f81f64-91f7-4441-8ef1-8ebf7a92b54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:05.860209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 487/963] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:06.203122 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561070c-9766-42c1-9f9f-221266173de7 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:06.208536 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=77 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:06.215699 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561070c-9766-42c1-9f9f-221266173de7 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:06.219230 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df300f57-ece5-4189-a5da-9e9dcc9d9bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:06.219844 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df300f57-ece5-4189-a5da-9e9dcc9d9bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:06.220132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df300f57-ece5-4189-a5da-9e9dcc9d9bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:06.220407 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df300f57-ece5-4189-a5da-9e9dcc9d9bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:06.230330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df300f57-ece5-4189-a5da-9e9dcc9d9bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:06.231759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df300f57-ece5-4189-a5da-9e9dcc9d9bc1 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:06.241616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 477/964] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:09.152016 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9d1a-0617-4426-ac4b-4025b95d0a95 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:09.152545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9d1a-0617-4426-ac4b-4025b95d0a95 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:09.152545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9d1a-0617-4426-ac4b-4025b95d0a95 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:09.153814 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 488/965] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:09.158979 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffe35a-60f6-45bc-bea9-1abe2d76494b None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:09.159380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffe35a-60f6-45bc-bea9-1abe2d76494b None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:09.159531 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffe35a-60f6-45bc-bea9-1abe2d76494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:09.178899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-03ffe35a-60f6-45bc-bea9-1abe2d76494b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:09.180201 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-03ffe35a-60f6-45bc-bea9-1abe2d76494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:09.188757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 478/966] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:09 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:09.538402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f9d1a-0617-4426-ac4b-4025b95d0a95 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:09.550001 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f9d1a-0617-4426-ac4b-4025b95d0a95 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:09.553535 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8779-b150-4114-9ffd-a57fc00d62ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:09.554124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8779-b150-4114-9ffd-a57fc00d62ee service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:09.554403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8779-b150-4114-9ffd-a57fc00d62ee service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:09.554672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8779-b150-4114-9ffd-a57fc00d62ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:09.563590 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a8779-b150-4114-9ffd-a57fc00d62ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:09.565058 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a8779-b150-4114-9ffd-a57fc00d62ee service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:09.575116 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 489/967] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:09 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:13.810395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871436-f7f0-49cb-8fa4-dfdf1e771d76 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:13.810836 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871436-f7f0-49cb-8fa4-dfdf1e771d76 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:13.811217 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871436-f7f0-49cb-8fa4-dfdf1e771d76 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:13.812329 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 479/968] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:13.818107 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af6c7-634a-423c-8850-c706bb76da5a None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:13.818509 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af6c7-634a-423c-8850-c706bb76da5a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:13.818594 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af6c7-634a-423c-8850-c706bb76da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:13.827783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=54 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:13.842876 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-f32af6c7-634a-423c-8850-c706bb76da5a None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:13.844494 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-f32af6c7-634a-423c-8850-c706bb76da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:13.856345 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 490/969] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:14.209626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19871436-f7f0-49cb-8fa4-dfdf1e771d76 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:14.220970 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19871436-f7f0-49cb-8fa4-dfdf1e771d76 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:14.224541 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801e40d-4310-491e-8a96-a951c8ba9583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:14.225131 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e40d-4310-491e-8a96-a951c8ba9583 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:14.225416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e40d-4310-491e-8a96-a951c8ba9583 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:14.225691 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e40d-4310-491e-8a96-a951c8ba9583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:14.234360 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801e40d-4310-491e-8a96-a951c8ba9583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:14.235788 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801e40d-4310-491e-8a96-a951c8ba9583 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:14.245187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 480/970] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:19.876138 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67df6-0769-4b19-b110-58631dc1c917 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:19.877435 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67df6-0769-4b19-b110-58631dc1c917 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:19.877940 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67df6-0769-4b19-b110-58631dc1c917 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:19.880316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 491/971] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 00:20:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:19.888088 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4deced-ade5-455c-b1ec-05d222367fff None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:19.888558 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4deced-ade5-455c-b1ec-05d222367fff None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:19.888658 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4deced-ade5-455c-b1ec-05d222367fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:20.002876 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-ad4deced-ade5-455c-b1ec-05d222367fff None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:20.004115 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-ad4deced-ade5-455c-b1ec-05d222367fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:20.114616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 481/972] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 00:20:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:20:23.837134 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=2 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:24.575141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb834-2b6c-4144-bd76-af0f709e718e None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:24.575793 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb834-2b6c-4144-bd76-af0f709e718e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:24.575793 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb834-2b6c-4144-bd76-af0f709e718e None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:24.577244 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 492/973] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 00:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:24.582474 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7479-b2c1-4466-92bf-1f9400b9b916 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:24.582950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7479-b2c1-4466-92bf-1f9400b9b916 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:24.583058 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7479-b2c1-4466-92bf-1f9400b9b916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:24.606379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-eaca7479-b2c1-4466-92bf-1f9400b9b916 None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:24.607715 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-eaca7479-b2c1-4466-92bf-1f9400b9b916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:24.616667 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 482/974] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 00:20:24 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:26.123080 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bd36e-40c1-4cb2-8281-e16111f98e98 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:26.123607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bd36e-40c1-4cb2-8281-e16111f98e98 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:26.123607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bd36e-40c1-4cb2-8281-e16111f98e98 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:26.125235 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 493/975] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 00:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:26.129990 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01c9a-9239-4aa3-a650-8ca5247bbbcc None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:26.130399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01c9a-9239-4aa3-a650-8ca5247bbbcc None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:26.130650 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01c9a-9239-4aa3-a650-8ca5247bbbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:26.151088 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-39e01c9a-9239-4aa3-a650-8ca5247bbbcc None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:26.152287 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-39e01c9a-9239-4aa3-a650-8ca5247bbbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:26.160713 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 483/976] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 00:20:26 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:30.117186 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1094-f713-4161-8eb5-ce5b213b0f1d None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:30.117680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1094-f713-4161-8eb5-ce5b213b0f1d None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:30.117680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1094-f713-4161-8eb5-ce5b213b0f1d None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:30.124193 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 494/977] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:30.125766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0005-9acc-420d-a007-028ea124f64f None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:30.126237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0005-9acc-420d-a007-028ea124f64f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:30.126332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0005-9acc-420d-a007-028ea124f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:30.147954 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-51ee0005-9acc-420d-a007-028ea124f64f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:30.149421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-51ee0005-9acc-420d-a007-028ea124f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:30.158473 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 484/978] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:20:30.530101 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45da51-fe25-4fa4-9690-3970d9448bab None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:30.530375 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45da51-fe25-4fa4-9690-3970d9448bab None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:30.530738 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45da51-fe25-4fa4-9690-3970d9448bab None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:30.532309 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 495/979] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 24 00:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:30.542720 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c9da-0798-4409-9d1e-741b2a2d2c58 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:30.543204 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c9da-0798-4409-9d1e-741b2a2d2c58 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:30.543970 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c9da-0798-4409-9d1e-741b2a2d2c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:30.585830 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-aee4c9da-0798-4409-9d1e-741b2a2d2c58 None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:30.587051 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-aee4c9da-0798-4409-9d1e-741b2a2d2c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:30.667386 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:30.674727 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 485/980] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 24 00:20:30 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:20:30.684204 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45da51-fe25-4fa4-9690-3970d9448bab None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:30.700106 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45da51-fe25-4fa4-9690-3970d9448bab None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:30.705055 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01d248-d443-45dd-b941-781a1cf6cd24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:30.705758 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01d248-d443-45dd-b941-781a1cf6cd24 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:30.706161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01d248-d443-45dd-b941-781a1cf6cd24 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:30.706525 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01d248-d443-45dd-b941-781a1cf6cd24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:30.716217 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01d248-d443-45dd-b941-781a1cf6cd24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:30.717917 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01d248-d443-45dd-b941-781a1cf6cd24 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:30.727872 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 496/981] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:33.178685 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3788a-aa69-48fc-b02f-1e886e076e28 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:33.179228 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3788a-aa69-48fc-b02f-1e886e076e28 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:33.179228 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3788a-aa69-48fc-b02f-1e886e076e28 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:33.180750 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 486/982] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:33.186976 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13bf1-8b81-4677-a882-3fbd3959c19b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:33.187387 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13bf1-8b81-4677-a882-3fbd3959c19b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:33.187576 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13bf1-8b81-4677-a882-3fbd3959c19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:33.207358 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-63c13bf1-8b81-4677-a882-3fbd3959c19b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:33.208565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-63c13bf1-8b81-4677-a882-3fbd3959c19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:33.220186 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 497/983] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:33.570109 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3788a-aa69-48fc-b02f-1e886e076e28 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:33.584738 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3788a-aa69-48fc-b02f-1e886e076e28 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:33.590503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee985a9-ec78-48cb-b8d4-637642f48c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:33.591205 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee985a9-ec78-48cb-b8d4-637642f48c05 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:33.591552 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee985a9-ec78-48cb-b8d4-637642f48c05 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:33.591928 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee985a9-ec78-48cb-b8d4-637642f48c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:33.600407 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee985a9-ec78-48cb-b8d4-637642f48c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:33.602087 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee985a9-ec78-48cb-b8d4-637642f48c05 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:33.612827 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 487/984] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:36.226273 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72675b-128e-4013-81ca-e1527a01bcb5 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:36.226824 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72675b-128e-4013-81ca-e1527a01bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:36.226824 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72675b-128e-4013-81ca-e1527a01bcb5 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:36.228371 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 498/985] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:36.233670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1a9f-8098-405d-af0d-cdcf8568c35f None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:36.234135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1a9f-8098-405d-af0d-cdcf8568c35f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:36.234243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1a9f-8098-405d-af0d-cdcf8568c35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:36.253929 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-fcce1a9f-8098-405d-af0d-cdcf8568c35f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:36.255105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-fcce1a9f-8098-405d-af0d-cdcf8568c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:36.263697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 488/986] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:36.619061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89ac1-d1d6-4e39-a3cb-2634d007be8a None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:36.619353 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89ac1-d1d6-4e39-a3cb-2634d007be8a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:36.619619 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89ac1-d1d6-4e39-a3cb-2634d007be8a None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:36.621868 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 499/987] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 24 00:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:36.629759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca045b-7856-45fd-b1f6-8b1d22eefd8b None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:36.630347 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca045b-7856-45fd-b1f6-8b1d22eefd8b None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:36.630848 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca045b-7856-45fd-b1f6-8b1d22eefd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:36.652451 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-baca045b-7856-45fd-b1f6-8b1d22eefd8b None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:36.653671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-baca045b-7856-45fd-b1f6-8b1d22eefd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:36.662464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 489/988] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 24 00:20:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:36.670866 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c89ac1-d1d6-4e39-a3cb-2634d007be8a None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:36.687434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c89ac1-d1d6-4e39-a3cb-2634d007be8a None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:36.694274 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036acf47-81cd-4711-8b09-4c3df85da4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:36.694869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036acf47-81cd-4711-8b09-4c3df85da4b4 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:36.695143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036acf47-81cd-4711-8b09-4c3df85da4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:36.695409 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036acf47-81cd-4711-8b09-4c3df85da4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:36.706404 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036acf47-81cd-4711-8b09-4c3df85da4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:36.708263 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036acf47-81cd-4711-8b09-4c3df85da4b4 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:36.718897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 500/989] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:39.154442 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4462-946f-4b99-8d3f-c89418ade4bc None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:39.154999 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4462-946f-4b99-8d3f-c89418ade4bc None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:39.155105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4462-946f-4b99-8d3f-c89418ade4bc None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:39.156420 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 490/990] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:39.161963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8371-d20c-4e0d-91fd-54e427407915 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:39.162445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8371-d20c-4e0d-91fd-54e427407915 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:39.162545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8371-d20c-4e0d-91fd-54e427407915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:39.185582 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e25d8371-d20c-4e0d-91fd-54e427407915 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:39.187249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e25d8371-d20c-4e0d-91fd-54e427407915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:39.204585 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 501/991] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:39.554949 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4462-946f-4b99-8d3f-c89418ade4bc None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:39.570666 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4462-946f-4b99-8d3f-c89418ade4bc None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:39.577712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9160df-f77e-4bed-9d78-98b278490037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:39.578556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9160df-f77e-4bed-9d78-98b278490037 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:39.579096 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9160df-f77e-4bed-9d78-98b278490037 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:39.579565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9160df-f77e-4bed-9d78-98b278490037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:39.589791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9160df-f77e-4bed-9d78-98b278490037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:39.591813 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9160df-f77e-4bed-9d78-98b278490037 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:39.619552 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 491/992] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:40.571549 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f15f0b-8e52-47a6-a442-4b92d21dd030 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:40.576963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f15f0b-8e52-47a6-a442-4b92d21dd030 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:40.577357 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f15f0b-8e52-47a6-a442-4b92d21dd030 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:40.578590 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 502/993] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:40.584607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e840e7-7066-43d8-8f0f-e003dff37fba None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:40.585032 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e840e7-7066-43d8-8f0f-e003dff37fba None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:40.585338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e840e7-7066-43d8-8f0f-e003dff37fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:40.616006 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-17e840e7-7066-43d8-8f0f-e003dff37fba None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:40.617380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-17e840e7-7066-43d8-8f0f-e003dff37fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:40.636423 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 492/994] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:41.265897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85421070-7d15-45ef-8677-1e7258693d4c None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:41.265897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85421070-7d15-45ef-8677-1e7258693d4c None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:41.265897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85421070-7d15-45ef-8677-1e7258693d4c None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:41.268347 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 503/995] 10.222.0.70 () {54 vars in 964 bytes} [Wed Aug 24 00:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:41.272316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490de32a-5685-4fe0-9e94-ff61be3853da None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:41.273163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490de32a-5685-4fe0-9e94-ff61be3853da None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:41.273163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490de32a-5685-4fe0-9e94-ff61be3853da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:41.311476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-490de32a-5685-4fe0-9e94-ff61be3853da None None] MFA Rules not processed for user `5c0f0416eaed4d8eaa78daa33fcf06b9`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:41.312729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-490de32a-5685-4fe0-9e94-ff61be3853da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:41.376622 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 493/996] 10.222.0.70 () {58 vars in 1061 bytes} [Wed Aug 24 00:20:41 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:41.384029 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85421070-7d15-45ef-8677-1e7258693d4c None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:41.395280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85421070-7d15-45ef-8677-1e7258693d4c None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:41.398728 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217344-c4e1-4097-afa3-3c69bcce2d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0416eaed4d8eaa78daa33fcf06b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:41.399325 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217344-c4e1-4097-afa3-3c69bcce2d7b service cinder] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:41.399594 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217344-c4e1-4097-afa3-3c69bcce2d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:41.400833 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217344-c4e1-4097-afa3-3c69bcce2d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:41.410247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217344-c4e1-4097-afa3-3c69bcce2d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:41.411697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217344-c4e1-4097-afa3-3c69bcce2d7b service cinder] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:41.421870 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 504/997] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:42.143710 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f832-dc71-47a5-a135-576eb5d1d70f None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:42.144181 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f832-dc71-47a5-a135-576eb5d1d70f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:42.144413 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f832-dc71-47a5-a135-576eb5d1d70f None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:42.145880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 494/998] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:42.153932 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867207d0-78cd-44c5-b86c-cba3d04c4b9f None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:42.155551 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867207d0-78cd-44c5-b86c-cba3d04c4b9f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:42.156552 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867207d0-78cd-44c5-b86c-cba3d04c4b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:42.204411 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-867207d0-78cd-44c5-b86c-cba3d04c4b9f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:42.208008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-867207d0-78cd-44c5-b86c-cba3d04c4b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:42.236496 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 505/999] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:42.601819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f832-dc71-47a5-a135-576eb5d1d70f None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:42.616997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f832-dc71-47a5-a135-576eb5d1d70f None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:42.622302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c36a65-b2e3-4872-b09c-677acd632728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:42.622918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36a65-b2e3-4872-b09c-677acd632728 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:42.623200 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36a65-b2e3-4872-b09c-677acd632728 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:42.623473 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36a65-b2e3-4872-b09c-677acd632728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:42.631779 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36a65-b2e3-4872-b09c-677acd632728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:42.633384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36a65-b2e3-4872-b09c-677acd632728 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:42.643463 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 495/1000] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:44.937274 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9610d-5ab7-45aa-8889-8a221e1c177f None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:44.937773 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9610d-5ab7-45aa-8889-8a221e1c177f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:44.937773 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9610d-5ab7-45aa-8889-8a221e1c177f None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:44.939076 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 506/1001] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:44.944315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44e68d-eb1f-41c8-a55c-0a3d421a50b1 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:44.945101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44e68d-eb1f-41c8-a55c-0a3d421a50b1 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:44.945380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44e68d-eb1f-41c8-a55c-0a3d421a50b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:44.965510 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-3d44e68d-eb1f-41c8-a55c-0a3d421a50b1 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:44.966697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-3d44e68d-eb1f-41c8-a55c-0a3d421a50b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:44.974813 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 496/1002] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:45.342345 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9610d-5ab7-45aa-8889-8a221e1c177f None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:45.362167 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9610d-5ab7-45aa-8889-8a221e1c177f None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:45.370161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3ede4-fbdd-4dd1-853d-b6c20cb13047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:45.371115 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ede4-fbdd-4dd1-853d-b6c20cb13047 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:45.371742 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ede4-fbdd-4dd1-853d-b6c20cb13047 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:45.372269 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ede4-fbdd-4dd1-853d-b6c20cb13047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:45.383247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3ede4-fbdd-4dd1-853d-b6c20cb13047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:45.386091 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3ede4-fbdd-4dd1-853d-b6c20cb13047 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:45.409003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 507/1003] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:47.711698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b7da-a88e-4750-8765-d30c17f2d4eb None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:47.712821 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b7da-a88e-4750-8765-d30c17f2d4eb None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:47.712821 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b7da-a88e-4750-8765-d30c17f2d4eb None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:47.714137 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 497/1004] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:47.719508 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13c8c-c87f-45e6-9443-f1b8fe42c710 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:47.719964 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13c8c-c87f-45e6-9443-f1b8fe42c710 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:47.720097 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13c8c-c87f-45e6-9443-f1b8fe42c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:47.739933 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-2bd13c8c-c87f-45e6-9443-f1b8fe42c710 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:47.741120 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-2bd13c8c-c87f-45e6-9443-f1b8fe42c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:47.750148 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 508/1005] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:48.099026 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b7da-a88e-4750-8765-d30c17f2d4eb None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:48.114548 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b7da-a88e-4750-8765-d30c17f2d4eb None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:48.119752 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda207e-e356-42a6-b72a-21ceb1683612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:48.120626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda207e-e356-42a6-b72a-21ceb1683612 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:48.121001 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda207e-e356-42a6-b72a-21ceb1683612 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:48.121383 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda207e-e356-42a6-b72a-21ceb1683612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:48.130803 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda207e-e356-42a6-b72a-21ceb1683612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:48.132444 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda207e-e356-42a6-b72a-21ceb1683612 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:48.145021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 498/1006] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:50.538870 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5decb0-979a-470b-b787-94de33d13593 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:50.539419 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5decb0-979a-470b-b787-94de33d13593 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:50.539540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5decb0-979a-470b-b787-94de33d13593 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:50.541885 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 509/1007] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:50.548497 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fefbc7-142e-4c24-8e55-e63d9417ad4d None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:50.549052 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fefbc7-142e-4c24-8e55-e63d9417ad4d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:50.549185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fefbc7-142e-4c24-8e55-e63d9417ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:50.572382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-b0fefbc7-142e-4c24-8e55-e63d9417ad4d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:50.573751 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-b0fefbc7-142e-4c24-8e55-e63d9417ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:50.582445 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 499/1008] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:20:51.027984 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5decb0-979a-470b-b787-94de33d13593 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:51.045155 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5decb0-979a-470b-b787-94de33d13593 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:51.051726 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d720b4-9293-49dd-9358-8f2b14be11d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:51.052504 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d720b4-9293-49dd-9358-8f2b14be11d1 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:51.052852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d720b4-9293-49dd-9358-8f2b14be11d1 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:51.053192 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d720b4-9293-49dd-9358-8f2b14be11d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:51.064372 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d720b4-9293-49dd-9358-8f2b14be11d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:51.066458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d720b4-9293-49dd-9358-8f2b14be11d1 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:51.078909 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 510/1009] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:53.636957 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec91592-c34f-4247-bb54-42d4b38e2c82 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:53.637417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec91592-c34f-4247-bb54-42d4b38e2c82 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:53.637417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec91592-c34f-4247-bb54-42d4b38e2c82 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:53.638820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 500/1010] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:53.644749 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718b0d-d21a-410a-839e-abc4a54f85a0 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:53.645239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718b0d-d21a-410a-839e-abc4a54f85a0 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:53.645348 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718b0d-d21a-410a-839e-abc4a54f85a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:53.669282 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-bf718b0d-d21a-410a-839e-abc4a54f85a0 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:53.670766 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-bf718b0d-d21a-410a-839e-abc4a54f85a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:53.681094 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 511/1011] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:54.159634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec91592-c34f-4247-bb54-42d4b38e2c82 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:54.174341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec91592-c34f-4247-bb54-42d4b38e2c82 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:54.179383 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2271e-19f0-4917-babb-a55869818c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:54.180038 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2271e-19f0-4917-babb-a55869818c43 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:54.180330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2271e-19f0-4917-babb-a55869818c43 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:54.180617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2271e-19f0-4917-babb-a55869818c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:54.190511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2271e-19f0-4917-babb-a55869818c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:54.192178 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2271e-19f0-4917-babb-a55869818c43 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:54.202547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 501/1012] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:57.086858 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b532-b178-4341-ad03-a7f9da9da2d5 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:57.087621 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b532-b178-4341-ad03-a7f9da9da2d5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:57.087621 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b532-b178-4341-ad03-a7f9da9da2d5 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:57.088819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 512/1013] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:57.094179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050996b-5634-457a-9ccb-7f738c219f06 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:57.094637 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050996b-5634-457a-9ccb-7f738c219f06 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:57.094742 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050996b-5634-457a-9ccb-7f738c219f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:57.115432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-8050996b-5634-457a-9ccb-7f738c219f06 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:57.116664 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-8050996b-5634-457a-9ccb-7f738c219f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:57.126075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 502/1014] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:57.488106 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b532-b178-4341-ad03-a7f9da9da2d5 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:57.490945 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=46 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:57.498284 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b532-b178-4341-ad03-a7f9da9da2d5 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:57.503243 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aa5ff-ec9e-4d31-89bb-7a8f8553fd96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:57.503857 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aa5ff-ec9e-4d31-89bb-7a8f8553fd96 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:57.504160 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aa5ff-ec9e-4d31-89bb-7a8f8553fd96 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:57.504432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aa5ff-ec9e-4d31-89bb-7a8f8553fd96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:57.512924 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91aa5ff-ec9e-4d31-89bb-7a8f8553fd96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:57.514500 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91aa5ff-ec9e-4d31-89bb-7a8f8553fd96 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:57.523956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 513/1015] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:57.849894 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206a329-e4f1-4752-a330-3599f1d1c7ed None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:57.850177 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206a329-e4f1-4752-a330-3599f1d1c7ed None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:57.850644 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206a329-e4f1-4752-a330-3599f1d1c7ed None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:57.852083 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 503/1016] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:57.857577 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393737-df0b-48c9-bab7-b4ac55e9406a None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:57.857868 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393737-df0b-48c9-bab7-b4ac55e9406a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:57.858260 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393737-df0b-48c9-bab7-b4ac55e9406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:57.878052 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-88393737-df0b-48c9-bab7-b4ac55e9406a None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:57.879238 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-88393737-df0b-48c9-bab7-b4ac55e9406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:57.887550 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 514/1017] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:58.250399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3207d8-10c2-4a87-8ff5-e532669184b3 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:58.250884 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3207d8-10c2-4a87-8ff5-e532669184b3 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:58.251015 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3207d8-10c2-4a87-8ff5-e532669184b3 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:58.252653 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 504/1018] 10.222.0.70 () {54 vars in 967 bytes} [Wed Aug 24 00:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:58.257801 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f748c8-5517-41fa-afde-59a18402fbbf None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:58.258276 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f748c8-5517-41fa-afde-59a18402fbbf None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:58.258389 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f748c8-5517-41fa-afde-59a18402fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:58.296133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-79f748c8-5517-41fa-afde-59a18402fbbf None None] MFA Rules not processed for user `2e31af0d7f814b0b86140be2c2d64f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:58.297633 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-79f748c8-5517-41fa-afde-59a18402fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:58.358161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 515/1019] 10.222.0.70 () {58 vars in 1064 bytes} [Wed Aug 24 00:20:58 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:58.365577 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3207d8-10c2-4a87-8ff5-e532669184b3 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:58.376704 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3207d8-10c2-4a87-8ff5-e532669184b3 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:58.380360 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41f7c1-beee-4070-9b38-7a04c537a487 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e31af0d7f814b0b86140be2c2d64f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:58.380953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41f7c1-beee-4070-9b38-7a04c537a487 service glance] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:58.381233 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41f7c1-beee-4070-9b38-7a04c537a487 service glance] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:58.381507 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41f7c1-beee-4070-9b38-7a04c537a487 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:58.391299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41f7c1-beee-4070-9b38-7a04c537a487 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:58.392758 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41f7c1-beee-4070-9b38-7a04c537a487 service glance] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:58.403046 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 505/1020] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:59.814537 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab1a6-cbce-4c46-a3a3-86d4f5b774a5 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:59.815168 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab1a6-cbce-4c46-a3a3-86d4f5b774a5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:59.815168 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab1a6-cbce-4c46-a3a3-86d4f5b774a5 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:59.816453 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 516/1021] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:59.822599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8cc2-143c-4fba-932f-effd12b82bc1 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:59.823080 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8cc2-143c-4fba-932f-effd12b82bc1 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:59.823210 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8cc2-143c-4fba-932f-effd12b82bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:59.865213 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-5d7d8cc2-143c-4fba-932f-effd12b82bc1 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:59.866418 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-5d7d8cc2-143c-4fba-932f-effd12b82bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:59.875328 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 506/1022] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:00.229783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab1a6-cbce-4c46-a3a3-86d4f5b774a5 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:00.243347 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab1a6-cbce-4c46-a3a3-86d4f5b774a5 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:00.249247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e5a7a-95cf-44f8-bc41-2830d8cc7df0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:00.249919 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e5a7a-95cf-44f8-bc41-2830d8cc7df0 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:00.250284 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e5a7a-95cf-44f8-bc41-2830d8cc7df0 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:00.250635 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e5a7a-95cf-44f8-bc41-2830d8cc7df0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:00.261933 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e5a7a-95cf-44f8-bc41-2830d8cc7df0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:00.263525 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e5a7a-95cf-44f8-bc41-2830d8cc7df0 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:00.273348 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 517/1023] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:02.579217 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5a32-69bf-4f44-99d6-0c561d4b0d5e None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:02.579941 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5a32-69bf-4f44-99d6-0c561d4b0d5e None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:02.579941 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5a32-69bf-4f44-99d6-0c561d4b0d5e None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:02.581282 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 507/1024] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:02.586974 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870291-2c54-44eb-82b1-db32b6e37f28 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:02.588088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870291-2c54-44eb-82b1-db32b6e37f28 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:02.588293 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870291-2c54-44eb-82b1-db32b6e37f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:02.610171 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-57870291-2c54-44eb-82b1-db32b6e37f28 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:02.611884 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-57870291-2c54-44eb-82b1-db32b6e37f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:02.629543 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 518/1025] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:21:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:02.984331 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf5a32-69bf-4f44-99d6-0c561d4b0d5e None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:02.991859 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=92 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:21:03.000012 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf5a32-69bf-4f44-99d6-0c561d4b0d5e None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:03.004955 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739340b5-d628-4b68-ad29-384538ab311d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:03.005555 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739340b5-d628-4b68-ad29-384538ab311d service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:03.005834 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739340b5-d628-4b68-ad29-384538ab311d service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:03.006105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739340b5-d628-4b68-ad29-384538ab311d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:03.015065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739340b5-d628-4b68-ad29-384538ab311d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:03.016698 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739340b5-d628-4b68-ad29-384538ab311d service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:03.027420 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 508/1026] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:12.604748 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=50 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:21:13.022148 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=5 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:21:13.702092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d2083-2586-45de-8967-b0f754cb7439 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:13.702701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d2083-2586-45de-8967-b0f754cb7439 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:13.702701 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d2083-2586-45de-8967-b0f754cb7439 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:13.703983 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 519/1027] 10.222.0.70 () {54 vars in 918 bytes} [Wed Aug 24 00:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:13.709118 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b356c-9a10-4a80-8846-171d0a1677a1 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:13.709398 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b356c-9a10-4a80-8846-171d0a1677a1 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:13.709669 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b356c-9a10-4a80-8846-171d0a1677a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:13.729798 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-208b356c-9a10-4a80-8846-171d0a1677a1 None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:13.736123 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-208b356c-9a10-4a80-8846-171d0a1677a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:13.744506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 509/1028] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Aug 24 00:21:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:13.758576 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4c7e7-0e94-4a05-a8b9-0f74c880281e None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:13.758856 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4c7e7-0e94-4a05-a8b9-0f74c880281e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:13.759158 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4c7e7-0e94-4a05-a8b9-0f74c880281e None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:13.760519 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 520/1029] 10.222.0.70 () {54 vars in 918 bytes} [Wed Aug 24 00:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:13.765110 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc67a9c-af4a-46cf-88e7-26bab140f8a2 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:13.765397 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc67a9c-af4a-46cf-88e7-26bab140f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:13.765676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc67a9c-af4a-46cf-88e7-26bab140f8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:13.785735 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-1dc67a9c-af4a-46cf-88e7-26bab140f8a2 None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:13.786934 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-1dc67a9c-af4a-46cf-88e7-26bab140f8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:13.796383 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 510/1030] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Aug 24 00:21:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:16.483240 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d37c1-a165-4b5c-99c4-74b24a729b3a None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:16.483653 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d37c1-a165-4b5c-99c4-74b24a729b3a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:16.483768 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d37c1-a165-4b5c-99c4-74b24a729b3a None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:16.485112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 521/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:16.490274 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e18dc-076b-4f00-ad7d-d52bc67d1774 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:16.490729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e18dc-076b-4f00-ad7d-d52bc67d1774 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:16.490825 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e18dc-076b-4f00-ad7d-d52bc67d1774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:16.510623 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-8c2e18dc-076b-4f00-ad7d-d52bc67d1774 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:16.511820 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-8c2e18dc-076b-4f00-ad7d-d52bc67d1774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:16.519719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 511/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:16.862127 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d37c1-a165-4b5c-99c4-74b24a729b3a None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:16.875408 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d37c1-a165-4b5c-99c4-74b24a729b3a None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:16.880329 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f7ceb-a6ec-40b8-95ce-84be2924b29c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:16.880910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7ceb-a6ec-40b8-95ce-84be2924b29c service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:16.881182 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7ceb-a6ec-40b8-95ce-84be2924b29c service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:16.881446 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7ceb-a6ec-40b8-95ce-84be2924b29c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:16.889957 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f7ceb-a6ec-40b8-95ce-84be2924b29c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:16.891547 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f7ceb-a6ec-40b8-95ce-84be2924b29c service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:16.903018 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 522/1033] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:17.888135 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd2c5-ac27-4f9f-9b90-a07d8cc52dd9 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:17.888718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd2c5-ac27-4f9f-9b90-a07d8cc52dd9 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:17.888718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd2c5-ac27-4f9f-9b90-a07d8cc52dd9 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:17.890028 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 512/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:17.895026 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fc67-a8c7-4bb3-b452-f4b3ca0201d3 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:17.895456 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fc67-a8c7-4bb3-b452-f4b3ca0201d3 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:17.895567 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fc67-a8c7-4bb3-b452-f4b3ca0201d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:17.914767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-fc93fc67-a8c7-4bb3-b452-f4b3ca0201d3 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:17.916610 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-fc93fc67-a8c7-4bb3-b452-f4b3ca0201d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:17.924699 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 523/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:21:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:18.140877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dd2c5-ac27-4f9f-9b90-a07d8cc52dd9 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:18.154685 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dd2c5-ac27-4f9f-9b90-a07d8cc52dd9 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:18.159600 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476d735-5671-4201-97c2-46cfc8a160c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:18.160218 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476d735-5671-4201-97c2-46cfc8a160c8 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:18.160508 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476d735-5671-4201-97c2-46cfc8a160c8 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:18.160768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476d735-5671-4201-97c2-46cfc8a160c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:18.169404 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476d735-5671-4201-97c2-46cfc8a160c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:18.171002 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476d735-5671-4201-97c2-46cfc8a160c8 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:18.180620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 513/1036] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:19.103433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078e623-57d8-49ab-8b83-790589e141ba None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:19.104025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078e623-57d8-49ab-8b83-790589e141ba None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:19.104025 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078e623-57d8-49ab-8b83-790589e141ba None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:19.105348 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 524/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:19.110373 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786999e5-8ce8-4725-a2ab-2eec179fa8d5 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:19.110902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786999e5-8ce8-4725-a2ab-2eec179fa8d5 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:19.110902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786999e5-8ce8-4725-a2ab-2eec179fa8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:19.129994 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-786999e5-8ce8-4725-a2ab-2eec179fa8d5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:19.131195 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-786999e5-8ce8-4725-a2ab-2eec179fa8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:19.139313 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 514/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:21:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:19.295094 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078e623-57d8-49ab-8b83-790589e141ba None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:19.308777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078e623-57d8-49ab-8b83-790589e141ba None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:19.313702 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e135a-7098-4554-a958-f4164de0242e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:19.314292 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e135a-7098-4554-a958-f4164de0242e service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:19.314573 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e135a-7098-4554-a958-f4164de0242e service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:19.314846 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e135a-7098-4554-a958-f4164de0242e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:19.323361 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e135a-7098-4554-a958-f4164de0242e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:19.325200 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e135a-7098-4554-a958-f4164de0242e service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:19.334839 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 525/1039] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:20.222402 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9894a1-489f-4ac9-8c61-10edb1d7d58c None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:20.223002 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9894a1-489f-4ac9-8c61-10edb1d7d58c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:20.223002 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9894a1-489f-4ac9-8c61-10edb1d7d58c None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:20.224338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 515/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:20.229306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c211e-fbac-4542-8afb-4c9b86e2efb7 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:20.229747 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c211e-fbac-4542-8afb-4c9b86e2efb7 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:20.229832 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c211e-fbac-4542-8afb-4c9b86e2efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:20.249005 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-c16c211e-fbac-4542-8afb-4c9b86e2efb7 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:20.250242 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-c16c211e-fbac-4542-8afb-4c9b86e2efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:20.258244 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 526/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:21:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:20.415399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9894a1-489f-4ac9-8c61-10edb1d7d58c None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:20.428919 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9894a1-489f-4ac9-8c61-10edb1d7d58c None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:20.434607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa913b4f-8725-4be3-9df6-57a0acfd4fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:20.435194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913b4f-8725-4be3-9df6-57a0acfd4fb3 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:20.435473 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913b4f-8725-4be3-9df6-57a0acfd4fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:20.435746 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913b4f-8725-4be3-9df6-57a0acfd4fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:20.443789 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa913b4f-8725-4be3-9df6-57a0acfd4fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:20.445375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa913b4f-8725-4be3-9df6-57a0acfd4fb3 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:20.455576 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 516/1042] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:21.338527 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631b355-27b5-4647-a658-89a37e6e3395 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:21.339073 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631b355-27b5-4647-a658-89a37e6e3395 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:21.339191 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631b355-27b5-4647-a658-89a37e6e3395 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:21.340471 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 527/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:21.345233 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833264-37f2-4fb7-baf6-c7113fd2194d None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:21.345669 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833264-37f2-4fb7-baf6-c7113fd2194d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:21.345774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833264-37f2-4fb7-baf6-c7113fd2194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:21.364890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-a5833264-37f2-4fb7-baf6-c7113fd2194d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:21.366084 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-a5833264-37f2-4fb7-baf6-c7113fd2194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:21.374385 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 517/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:21:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:21.545378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631b355-27b5-4647-a658-89a37e6e3395 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:21.559677 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631b355-27b5-4647-a658-89a37e6e3395 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:21.564628 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16ba2b-3934-4a91-97b7-0ae76d4ad925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:21.565210 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ba2b-3934-4a91-97b7-0ae76d4ad925 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:21.565484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ba2b-3934-4a91-97b7-0ae76d4ad925 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:21.565751 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ba2b-3934-4a91-97b7-0ae76d4ad925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:21.574405 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16ba2b-3934-4a91-97b7-0ae76d4ad925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:21.576003 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16ba2b-3934-4a91-97b7-0ae76d4ad925 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:21.588239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 528/1045] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:22.406320 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc658-9eff-45ef-99e4-1a87b806eba9 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:22.406939 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc658-9eff-45ef-99e4-1a87b806eba9 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:22.406939 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc658-9eff-45ef-99e4-1a87b806eba9 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:22.408256 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 518/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:22.412998 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b985-7f50-46e2-93ff-1c77ce2bef0b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:22.413434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b985-7f50-46e2-93ff-1c77ce2bef0b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:22.413531 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b985-7f50-46e2-93ff-1c77ce2bef0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:22.432782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-4232b985-7f50-46e2-93ff-1c77ce2bef0b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:22.433986 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-4232b985-7f50-46e2-93ff-1c77ce2bef0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:22.441737 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 529/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:21:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:22.598194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dc658-9eff-45ef-99e4-1a87b806eba9 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:22.612438 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dc658-9eff-45ef-99e4-1a87b806eba9 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:22.617469 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4d3e6-2b19-4a51-994c-26d51297e5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:22.618072 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d3e6-2b19-4a51-994c-26d51297e5a3 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:22.618953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d3e6-2b19-4a51-994c-26d51297e5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:22.619314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d3e6-2b19-4a51-994c-26d51297e5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:22.629791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4d3e6-2b19-4a51-994c-26d51297e5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:22.631534 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4d3e6-2b19-4a51-994c-26d51297e5a3 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:22.642064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 519/1048] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:23.458614 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ba31a-b51f-49e4-a5a5-395a1c34bd57 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:23.459153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ba31a-b51f-49e4-a5a5-395a1c34bd57 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:23.459153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ba31a-b51f-49e4-a5a5-395a1c34bd57 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:23.460526 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 530/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:23.465981 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaa1c7-2e0f-46c0-96ac-703fec518128 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:23.466423 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaa1c7-2e0f-46c0-96ac-703fec518128 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:23.466522 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaa1c7-2e0f-46c0-96ac-703fec518128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:23.488211 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-90aaa1c7-2e0f-46c0-96ac-703fec518128 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:23.489392 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-90aaa1c7-2e0f-46c0-96ac-703fec518128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:23.497222 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 520/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:21:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:23.653304 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ba31a-b51f-49e4-a5a5-395a1c34bd57 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:23.667367 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ba31a-b51f-49e4-a5a5-395a1c34bd57 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:23.672474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095b73-c8f4-45dd-ba28-7241133c3dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:23.673059 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095b73-c8f4-45dd-ba28-7241133c3dc5 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:23.673338 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095b73-c8f4-45dd-ba28-7241133c3dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:23.673604 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095b73-c8f4-45dd-ba28-7241133c3dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:23.681825 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095b73-c8f4-45dd-ba28-7241133c3dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:23.683422 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095b73-c8f4-45dd-ba28-7241133c3dc5 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:23.692707 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 531/1051] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:24.512899 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408112-f63f-4e25-add0-610caf2878c2 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:24.513409 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408112-f63f-4e25-add0-610caf2878c2 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:24.513520 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408112-f63f-4e25-add0-610caf2878c2 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:24.514800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 521/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:24.519618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae183c-fc5c-4d01-b063-f493cf1c7e80 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:24.520043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae183c-fc5c-4d01-b063-f493cf1c7e80 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:24.520198 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae183c-fc5c-4d01-b063-f493cf1c7e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:24.539552 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e7ae183c-fc5c-4d01-b063-f493cf1c7e80 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:24.540892 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e7ae183c-fc5c-4d01-b063-f493cf1c7e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:24.548899 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 532/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:21:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:24.703397 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408112-f63f-4e25-add0-610caf2878c2 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:24.716950 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408112-f63f-4e25-add0-610caf2878c2 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:24.721991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2083fa-9f25-4565-ac3b-40d9df478082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:24.722585 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2083fa-9f25-4565-ac3b-40d9df478082 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:24.722868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2083fa-9f25-4565-ac3b-40d9df478082 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:24.723141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2083fa-9f25-4565-ac3b-40d9df478082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:24.732164 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2083fa-9f25-4565-ac3b-40d9df478082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:24.733683 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2083fa-9f25-4565-ac3b-40d9df478082 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:24.743063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 522/1054] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:25.567880 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba73d-27bd-425a-b569-d0562eb875de None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:25.568458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba73d-27bd-425a-b569-d0562eb875de None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:25.568458 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba73d-27bd-425a-b569-d0562eb875de None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:25.569762 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 533/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:25.574598 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b12c6-5c67-483e-8d5c-e308a2d6d3b8 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:25.575035 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b12c6-5c67-483e-8d5c-e308a2d6d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:25.575154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b12c6-5c67-483e-8d5c-e308a2d6d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:25.594538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-d52b12c6-5c67-483e-8d5c-e308a2d6d3b8 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:25.595736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-d52b12c6-5c67-483e-8d5c-e308a2d6d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:25.604097 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 523/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:21:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:25.761422 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba73d-27bd-425a-b569-d0562eb875de None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:25.775183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba73d-27bd-425a-b569-d0562eb875de None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:25.780138 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d3228-e938-4be0-9864-c741692250fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:25.780723 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3228-e938-4be0-9864-c741692250fc service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:25.781002 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3228-e938-4be0-9864-c741692250fc service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:25.781274 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3228-e938-4be0-9864-c741692250fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:25.789582 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d3228-e938-4be0-9864-c741692250fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:25.791854 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d3228-e938-4be0-9864-c741692250fc service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:25.801497 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 534/1057] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:27.901794 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b95e1-e44d-4756-a369-4140803b177b None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:27.902375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b95e1-e44d-4756-a369-4140803b177b None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:27.902375 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b95e1-e44d-4756-a369-4140803b177b None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:27.903751 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 524/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:27.909257 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495083f5-ce0c-44bb-8d79-0254c7d76da5 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:27.909688 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495083f5-ce0c-44bb-8d79-0254c7d76da5 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:27.909795 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495083f5-ce0c-44bb-8d79-0254c7d76da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:27.928935 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-495083f5-ce0c-44bb-8d79-0254c7d76da5 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:27.930243 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-495083f5-ce0c-44bb-8d79-0254c7d76da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:27.938670 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 535/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:28.286174 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b95e1-e44d-4756-a369-4140803b177b None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:28.297055 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b95e1-e44d-4756-a369-4140803b177b None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:28.300991 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7e649-1d60-494d-a306-b292321e0d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:28.301573 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7e649-1d60-494d-a306-b292321e0d9a service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:28.301847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7e649-1d60-494d-a306-b292321e0d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:28.302113 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7e649-1d60-494d-a306-b292321e0d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:28.312027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7e649-1d60-494d-a306-b292321e0d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:28.313455 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7e649-1d60-494d-a306-b292321e0d9a service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:28.323497 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 525/1060] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:30.686419 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d511d64-c78f-4568-ac40-8c9a3386ab06 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:30.686928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d511d64-c78f-4568-ac40-8c9a3386ab06 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:30.686928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d511d64-c78f-4568-ac40-8c9a3386ab06 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:30.688244 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 536/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:30.693689 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3529-463f-4e2e-82b9-b464c8f0df54 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:30.694120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3529-463f-4e2e-82b9-b464c8f0df54 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:30.694244 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3529-463f-4e2e-82b9-b464c8f0df54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:30.717542 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-6cec3529-463f-4e2e-82b9-b464c8f0df54 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:30.718763 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-6cec3529-463f-4e2e-82b9-b464c8f0df54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:30.730718 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 526/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:31.077498 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d511d64-c78f-4568-ac40-8c9a3386ab06 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:31.088338 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d511d64-c78f-4568-ac40-8c9a3386ab06 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:31.091784 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e4629-6ffd-47c1-9851-c9b5303028d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:31.092401 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e4629-6ffd-47c1-9851-c9b5303028d4 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:31.092680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e4629-6ffd-47c1-9851-c9b5303028d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:31.092955 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e4629-6ffd-47c1-9851-c9b5303028d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:31.101803 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e4629-6ffd-47c1-9851-c9b5303028d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:31.103309 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e4629-6ffd-47c1-9851-c9b5303028d4 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:31.112700 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 537/1063] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:21:33.630181 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d6932-da3b-46cd-b20f-b4ad4d97f826 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:33.630714 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d6932-da3b-46cd-b20f-b4ad4d97f826 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:33.630714 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d6932-da3b-46cd-b20f-b4ad4d97f826 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:33.632104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 527/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:33.637836 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee23d0-a2b8-4482-beaa-b95774d1779d None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:33.638265 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee23d0-a2b8-4482-beaa-b95774d1779d None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:33.638378 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee23d0-a2b8-4482-beaa-b95774d1779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:33.657780 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e7ee23d0-a2b8-4482-beaa-b95774d1779d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:33.658963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e7ee23d0-a2b8-4482-beaa-b95774d1779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:33.666881 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 538/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:34.009581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d6932-da3b-46cd-b20f-b4ad4d97f826 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:34.020236 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d6932-da3b-46cd-b20f-b4ad4d97f826 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:34.023736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e2f0b-ad27-4bc7-b782-d7bf9c8e01d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:34.024852 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e2f0b-ad27-4bc7-b782-d7bf9c8e01d0 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:34.025301 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e2f0b-ad27-4bc7-b782-d7bf9c8e01d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:34.025581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e2f0b-ad27-4bc7-b782-d7bf9c8e01d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:34.034866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e2f0b-ad27-4bc7-b782-d7bf9c8e01d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:34.036325 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e2f0b-ad27-4bc7-b782-d7bf9c8e01d0 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:34.046344 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 528/1066] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:36.375335 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b76df6-e311-45e6-a05b-70446d575802 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:36.375938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b76df6-e311-45e6-a05b-70446d575802 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:36.375938 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b76df6-e311-45e6-a05b-70446d575802 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:36.377245 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 539/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:36.382566 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e44f1-7f3e-43a0-972a-bee4cd2f4ec7 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:36.382990 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e44f1-7f3e-43a0-972a-bee4cd2f4ec7 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:36.383108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e44f1-7f3e-43a0-972a-bee4cd2f4ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:36.402471 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-719e44f1-7f3e-43a0-972a-bee4cd2f4ec7 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:36.403663 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-719e44f1-7f3e-43a0-972a-bee4cd2f4ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:36.411348 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 529/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:36.762237 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b76df6-e311-45e6-a05b-70446d575802 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:36.772847 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b76df6-e311-45e6-a05b-70446d575802 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:36.776341 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385eee3-b09e-44d4-8a43-1b684166657b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:36.776956 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385eee3-b09e-44d4-8a43-1b684166657b service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:36.777232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385eee3-b09e-44d4-8a43-1b684166657b service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:36.777502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385eee3-b09e-44d4-8a43-1b684166657b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:36.786146 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385eee3-b09e-44d4-8a43-1b684166657b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:36.787571 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385eee3-b09e-44d4-8a43-1b684166657b service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:36.797813 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 540/1069] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:39.049659 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c0a0-f262-4712-a626-19fbb1d4badf None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:39.050179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c0a0-f262-4712-a626-19fbb1d4badf None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:39.050288 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c0a0-f262-4712-a626-19fbb1d4badf None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:39.051551 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 530/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:39.057851 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa436496-b002-4ca4-a2b4-20fe2c167fc2 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:39.058265 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa436496-b002-4ca4-a2b4-20fe2c167fc2 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:39.058375 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa436496-b002-4ca4-a2b4-20fe2c167fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:39.077366 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-fa436496-b002-4ca4-a2b4-20fe2c167fc2 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:39.078552 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-fa436496-b002-4ca4-a2b4-20fe2c167fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:39.086167 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 541/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:39.425808 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3c0a0-f262-4712-a626-19fbb1d4badf None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:39.436684 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3c0a0-f262-4712-a626-19fbb1d4badf None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:39.440287 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa376b-c2e6-4a56-953b-da57db6bef3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:39.440874 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa376b-c2e6-4a56-953b-da57db6bef3f service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:39.441154 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa376b-c2e6-4a56-953b-da57db6bef3f service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:39.441426 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa376b-c2e6-4a56-953b-da57db6bef3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:39.450160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa376b-c2e6-4a56-953b-da57db6bef3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:39.451576 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa376b-c2e6-4a56-953b-da57db6bef3f service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:39.461316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 531/1072] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:41.724326 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787089d-7d63-4daa-8389-119df499e7a1 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:41.724897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787089d-7d63-4daa-8389-119df499e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:41.724897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787089d-7d63-4daa-8389-119df499e7a1 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:41.726239 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 542/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:41.731941 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bef082-8ff3-4d9b-9b9d-aed4b4b3b48d None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:41.732349 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bef082-8ff3-4d9b-9b9d-aed4b4b3b48d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:41.732458 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bef082-8ff3-4d9b-9b9d-aed4b4b3b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:41.752069 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-96bef082-8ff3-4d9b-9b9d-aed4b4b3b48d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:41.753266 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-96bef082-8ff3-4d9b-9b9d-aed4b4b3b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:41.761691 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 532/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:42.107322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787089d-7d63-4daa-8389-119df499e7a1 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:42.118153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787089d-7d63-4daa-8389-119df499e7a1 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:42.122175 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f58c-9eb0-4bb1-97ab-7f73dfeab1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:42.122759 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f58c-9eb0-4bb1-97ab-7f73dfeab1ab service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:42.123037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f58c-9eb0-4bb1-97ab-7f73dfeab1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:42.123310 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f58c-9eb0-4bb1-97ab-7f73dfeab1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:42.132061 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f58c-9eb0-4bb1-97ab-7f73dfeab1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:42.133481 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f58c-9eb0-4bb1-97ab-7f73dfeab1ab service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:42.143322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 543/1075] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:44.486391 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991107f-2c70-4453-94f0-63218b91c136 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:44.486849 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991107f-2c70-4453-94f0-63218b91c136 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:44.486962 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991107f-2c70-4453-94f0-63218b91c136 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:44.488327 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 533/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:44.493967 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24afdae-c7a5-4184-9980-47d4cc95735c None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:44.494411 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24afdae-c7a5-4184-9980-47d4cc95735c None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:44.494542 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24afdae-c7a5-4184-9980-47d4cc95735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:44.501943 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=70 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:21:44.514640 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e24afdae-c7a5-4184-9980-47d4cc95735c None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:44.515843 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e24afdae-c7a5-4184-9980-47d4cc95735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:44.523438 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 544/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:44.860940 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991107f-2c70-4453-94f0-63218b91c136 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:44.866292 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=73 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:21:44.872752 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991107f-2c70-4453-94f0-63218b91c136 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:44.876194 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660525fb-33f6-4689-8500-b6619d00a0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:44.876799 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660525fb-33f6-4689-8500-b6619d00a0da service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:44.877079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660525fb-33f6-4689-8500-b6619d00a0da service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:44.877352 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660525fb-33f6-4689-8500-b6619d00a0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:44.886592 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660525fb-33f6-4689-8500-b6619d00a0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:44.888035 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660525fb-33f6-4689-8500-b6619d00a0da service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:44.897261 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 534/1078] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:21:47.154191 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ecdf2-bc72-48d5-898e-e17e7b36607b None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:47.154781 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ecdf2-bc72-48d5-898e-e17e7b36607b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:47.154881 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ecdf2-bc72-48d5-898e-e17e7b36607b None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:47.156200 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 545/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:47.161688 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88952db-bff1-479e-a2ae-d53bbcb81633 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:47.162116 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88952db-bff1-479e-a2ae-d53bbcb81633 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:47.162245 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88952db-bff1-479e-a2ae-d53bbcb81633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:47.182601 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-b88952db-bff1-479e-a2ae-d53bbcb81633 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:47.183802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-b88952db-bff1-479e-a2ae-d53bbcb81633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:47.191520 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 535/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:47.536181 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ecdf2-bc72-48d5-898e-e17e7b36607b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:47.547421 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ecdf2-bc72-48d5-898e-e17e7b36607b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:47.551193 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c4d74-acad-4302-b579-5b26607f0c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:47.551779 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4d74-acad-4302-b579-5b26607f0c47 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:47.552155 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4d74-acad-4302-b579-5b26607f0c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:47.552431 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4d74-acad-4302-b579-5b26607f0c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:47.561706 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c4d74-acad-4302-b579-5b26607f0c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:47.563164 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c4d74-acad-4302-b579-5b26607f0c47 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:47.572709 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 546/1081] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:49.915309 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1131-5c58-4d0d-abb0-9022060de5e3 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:49.915901 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1131-5c58-4d0d-abb0-9022060de5e3 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:49.916037 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1131-5c58-4d0d-abb0-9022060de5e3 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:49.917303 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 536/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:49.923120 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecbbe4-57b3-4bcb-a149-e6d9b6cdb3fc None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:49.923680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecbbe4-57b3-4bcb-a149-e6d9b6cdb3fc None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:49.923680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecbbe4-57b3-4bcb-a149-e6d9b6cdb3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:49.944013 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-daecbbe4-57b3-4bcb-a149-e6d9b6cdb3fc None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:49.945247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-daecbbe4-57b3-4bcb-a149-e6d9b6cdb3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:49.953580 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 547/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:50.301545 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca1131-5c58-4d0d-abb0-9022060de5e3 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:50.312373 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca1131-5c58-4d0d-abb0-9022060de5e3 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:50.315881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03525204-ce49-4b0e-9309-b9a19ddb0f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:50.316472 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03525204-ce49-4b0e-9309-b9a19ddb0f9f service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:50.316753 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03525204-ce49-4b0e-9309-b9a19ddb0f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:50.317026 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03525204-ce49-4b0e-9309-b9a19ddb0f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:50.326249 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03525204-ce49-4b0e-9309-b9a19ddb0f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:50.327670 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03525204-ce49-4b0e-9309-b9a19ddb0f9f service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:50.337961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 537/1084] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:52.552357 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee5fa1-2332-4fb7-8505-2a0ab6687bfb None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:52.552918 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee5fa1-2332-4fb7-8505-2a0ab6687bfb None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:52.552918 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee5fa1-2332-4fb7-8505-2a0ab6687bfb None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:52.554220 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 548/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:21:52.560165 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e2aad-bfd6-48ce-9409-46d1d2b6e255 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:52.560606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e2aad-bfd6-48ce-9409-46d1d2b6e255 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:52.560712 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e2aad-bfd6-48ce-9409-46d1d2b6e255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:52.579526 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-a38e2aad-bfd6-48ce-9409-46d1d2b6e255 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:52.580788 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-a38e2aad-bfd6-48ce-9409-46d1d2b6e255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:52.588645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 538/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:21:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:52.934793 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee5fa1-2332-4fb7-8505-2a0ab6687bfb None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:52.945480 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee5fa1-2332-4fb7-8505-2a0ab6687bfb None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:52.949050 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfde01-2909-46b4-b4ba-395addc724e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:52.949629 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfde01-2909-46b4-b4ba-395addc724e1 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:52.949903 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfde01-2909-46b4-b4ba-395addc724e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:52.950169 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfde01-2909-46b4-b4ba-395addc724e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:52.958791 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfde01-2909-46b4-b4ba-395addc724e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:52.960327 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfde01-2909-46b4-b4ba-395addc724e1 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:52.970261 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 549/1087] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:22:02.574838 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=17 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:22:02.966151 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=17 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:22:17.097164 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0e69-a625-4a48-922f-a90c9e16f9f1 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:17.097766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0e69-a625-4a48-922f-a90c9e16f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:17.097766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0e69-a625-4a48-922f-a90c9e16f9f1 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:17.099034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 539/1088] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:17.104295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b676981-06b5-43dc-ad1a-793ee78189df None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:17.104775 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b676981-06b5-43dc-ad1a-793ee78189df None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:17.104879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b676981-06b5-43dc-ad1a-793ee78189df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:17.123300 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-0b676981-06b5-43dc-ad1a-793ee78189df None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:17.124502 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-0b676981-06b5-43dc-ad1a-793ee78189df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:17.132112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 550/1089] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:22:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:22:17.490457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4872-5ca1-40d7-ab56-3cc1aa3a6f55 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:17.490740 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4872-5ca1-40d7-ab56-3cc1aa3a6f55 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:17.491011 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4872-5ca1-40d7-ab56-3cc1aa3a6f55 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:17.492380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 540/1090] 10.222.0.70 () {54 vars in 967 bytes} [Wed Aug 24 00:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:17.497971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfd8b-cc1f-446e-b964-cba69a38fc34 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:17.498256 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfd8b-cc1f-446e-b964-cba69a38fc34 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:17.498530 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfd8b-cc1f-446e-b964-cba69a38fc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:17.518050 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-5e2cfd8b-cc1f-446e-b964-cba69a38fc34 None None] MFA Rules not processed for user `2e31af0d7f814b0b86140be2c2d64f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:17.519249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-5e2cfd8b-cc1f-446e-b964-cba69a38fc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:17.525800 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 551/1091] 10.222.0.70 () {58 vars in 1064 bytes} [Wed Aug 24 00:22:17 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:17.532975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a4872-5ca1-40d7-ab56-3cc1aa3a6f55 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:17.543903 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a4872-5ca1-40d7-ab56-3cc1aa3a6f55 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:17.547332 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa26a0-f231-4384-b87e-e05c29d96509 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e31af0d7f814b0b86140be2c2d64f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:17.548217 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa26a0-f231-4384-b87e-e05c29d96509 service glance] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:17.548493 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa26a0-f231-4384-b87e-e05c29d96509 service glance] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:17.548762 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa26a0-f231-4384-b87e-e05c29d96509 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:17.558242 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa26a0-f231-4384-b87e-e05c29d96509 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:17.559636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa26a0-f231-4384-b87e-e05c29d96509 service glance] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:17.568830 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 541/1092] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:22:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:22:19.898773 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948e4c-4578-4a2d-a1f2-ddfe4020f341 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:19.899540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948e4c-4578-4a2d-a1f2-ddfe4020f341 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:19.899540 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948e4c-4578-4a2d-a1f2-ddfe4020f341 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:19.902099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 552/1093] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:19.906484 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739c386-26c6-48e0-8aa1-d926bc867868 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:19.906918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739c386-26c6-48e0-8aa1-d926bc867868 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:19.907034 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739c386-26c6-48e0-8aa1-d926bc867868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:19.926185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f739c386-26c6-48e0-8aa1-d926bc867868 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:19.927389 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f739c386-26c6-48e0-8aa1-d926bc867868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:19.935533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 542/1094] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:22:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:20.273192 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948e4c-4578-4a2d-a1f2-ddfe4020f341 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:20.286418 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948e4c-4578-4a2d-a1f2-ddfe4020f341 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:20.291116 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ab742-3c0c-41e6-afa6-9a0a4a95e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:20.291697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ab742-3c0c-41e6-afa6-9a0a4a95e111 admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:20.292030 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ab742-3c0c-41e6-afa6-9a0a4a95e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:20.292304 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ab742-3c0c-41e6-afa6-9a0a4a95e111 admin admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:20.292936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ab742-3c0c-41e6-afa6-9a0a4a95e111 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:20.294660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING py.warnings [None req-249ab742-3c0c-41e6-afa6-9a0a4a95e111 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:20.294660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: warnings.warn(msg) Aug 24 00:22:20.294660 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: Aug 24 00:22:20.295807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ab742-3c0c-41e6-afa6-9a0a4a95e111 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:20.313634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 553/1095] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 00:22:20 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:22:22.541841 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771958dd-3ce7-4c79-bb2e-b8582699c966 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:22.542393 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771958dd-3ce7-4c79-bb2e-b8582699c966 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:22.542393 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771958dd-3ce7-4c79-bb2e-b8582699c966 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:22.543729 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 543/1096] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:22.549297 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b085-9c91-4cbd-a8d6-eeca974dea9b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:22.549767 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b085-9c91-4cbd-a8d6-eeca974dea9b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:22.549864 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b085-9c91-4cbd-a8d6-eeca974dea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:22.569028 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-fdd3b085-9c91-4cbd-a8d6-eeca974dea9b None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:22.570233 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-fdd3b085-9c91-4cbd-a8d6-eeca974dea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:22.578943 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 554/1097] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:22:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:22.934260 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771958dd-3ce7-4c79-bb2e-b8582699c966 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:22.948356 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771958dd-3ce7-4c79-bb2e-b8582699c966 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:22.953208 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86f72b-700b-431b-aaa6-fd9f8015f77d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:22.953795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f72b-700b-431b-aaa6-fd9f8015f77d service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:22.954072 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f72b-700b-431b-aaa6-fd9f8015f77d service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:22.954348 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f72b-700b-431b-aaa6-fd9f8015f77d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:22.962822 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86f72b-700b-431b-aaa6-fd9f8015f77d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:22.964430 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86f72b-700b-431b-aaa6-fd9f8015f77d service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:22.973616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 544/1098] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:22:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:22:25.363948 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57ac9a-c1ef-46b7-8e5e-474a00d585ed None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:25.364491 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57ac9a-c1ef-46b7-8e5e-474a00d585ed None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:25.364491 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57ac9a-c1ef-46b7-8e5e-474a00d585ed None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:25.365818 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 555/1099] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:25.371008 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3021-6348-485a-a057-eeaac65f5286 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:25.371408 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3021-6348-485a-a057-eeaac65f5286 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:25.371565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3021-6348-485a-a057-eeaac65f5286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:25.390881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-dadd3021-6348-485a-a057-eeaac65f5286 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:25.392136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-dadd3021-6348-485a-a057-eeaac65f5286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:25.400613 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 545/1100] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:22:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:25.745036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57ac9a-c1ef-46b7-8e5e-474a00d585ed None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:25.755495 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57ac9a-c1ef-46b7-8e5e-474a00d585ed None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:25.759731 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31a360-901d-4fa6-9fc5-f3f2a6dafa29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:25.760356 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a360-901d-4fa6-9fc5-f3f2a6dafa29 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:25.760634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a360-901d-4fa6-9fc5-f3f2a6dafa29 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:25.760903 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a360-901d-4fa6-9fc5-f3f2a6dafa29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:25.770141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31a360-901d-4fa6-9fc5-f3f2a6dafa29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:25.771761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31a360-901d-4fa6-9fc5-f3f2a6dafa29 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:25.781641 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 556/1101] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:22:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:22:28.029243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabbb53-5eaa-4f03-84c9-a32e73fe5198 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:28.029802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabbb53-5eaa-4f03-84c9-a32e73fe5198 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:28.029802 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabbb53-5eaa-4f03-84c9-a32e73fe5198 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:28.031132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 546/1102] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:28.036588 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1543-21b4-4fa2-bf5b-a1ddd1963b81 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:28.037019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1543-21b4-4fa2-bf5b-a1ddd1963b81 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:28.037140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1543-21b4-4fa2-bf5b-a1ddd1963b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:28.057083 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e1ee1543-21b4-4fa2-bf5b-a1ddd1963b81 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:28.058287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e1ee1543-21b4-4fa2-bf5b-a1ddd1963b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:28.066218 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 557/1103] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:22:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:28.424244 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabbb53-5eaa-4f03-84c9-a32e73fe5198 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:28.435027 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabbb53-5eaa-4f03-84c9-a32e73fe5198 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:28.438432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff549ff0-3a86-45bf-8e08-9c81a2ed9ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:28.439012 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff549ff0-3a86-45bf-8e08-9c81a2ed9ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:28.439283 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff549ff0-3a86-45bf-8e08-9c81a2ed9ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:28.439548 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff549ff0-3a86-45bf-8e08-9c81a2ed9ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:28.448803 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff549ff0-3a86-45bf-8e08-9c81a2ed9ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:28.450203 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff549ff0-3a86-45bf-8e08-9c81a2ed9ce3 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:28.459336 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 547/1104] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:22:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:22:30.761620 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f0c3-11d1-435b-836c-186e8f8dc328 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:30.762152 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f0c3-11d1-435b-836c-186e8f8dc328 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:30.762152 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f0c3-11d1-435b-836c-186e8f8dc328 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:30.763387 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 558/1105] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:30.768657 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a38290-58fc-489a-810a-79fe5c503158 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:30.769052 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a38290-58fc-489a-810a-79fe5c503158 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:30.769206 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a38290-58fc-489a-810a-79fe5c503158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:30.788663 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-61a38290-58fc-489a-810a-79fe5c503158 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:30.790468 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-61a38290-58fc-489a-810a-79fe5c503158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:30.798433 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 548/1106] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:22:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:31.150425 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15f0c3-11d1-435b-836c-186e8f8dc328 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:31.161138 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15f0c3-11d1-435b-836c-186e8f8dc328 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:31.165359 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aeea8-a514-4fcb-b8ca-8d4743d35f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:31.165945 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aeea8-a514-4fcb-b8ca-8d4743d35f8b service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:31.166223 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aeea8-a514-4fcb-b8ca-8d4743d35f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:31.166498 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aeea8-a514-4fcb-b8ca-8d4743d35f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:31.175477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3aeea8-a514-4fcb-b8ca-8d4743d35f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:31.176936 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3aeea8-a514-4fcb-b8ca-8d4743d35f8b service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:31.186520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 559/1107] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:22:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:22:33.563167 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37694df-d271-4850-b16d-ac4e86c13cde None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:33.563690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37694df-d271-4850-b16d-ac4e86c13cde None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:33.563690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37694df-d271-4850-b16d-ac4e86c13cde None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:33.565067 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 549/1108] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 00:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:33.570195 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5e5dc-2771-4947-b192-298e7210c38f None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:33.571232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5e5dc-2771-4947-b192-298e7210c38f None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:33.571337 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5e5dc-2771-4947-b192-298e7210c38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:33.590810 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-7ba5e5dc-2771-4947-b192-298e7210c38f None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:33.592043 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-7ba5e5dc-2771-4947-b192-298e7210c38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:33.599884 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 560/1109] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 00:22:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:33.942243 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37694df-d271-4850-b16d-ac4e86c13cde None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:33.953028 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37694df-d271-4850-b16d-ac4e86c13cde None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:33.956395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee5e15-0946-42d1-a8c9-a0a649740458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:33.956972 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5e15-0946-42d1-a8c9-a0a649740458 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:33.957246 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5e15-0946-42d1-a8c9-a0a649740458 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:33.957515 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5e15-0946-42d1-a8c9-a0a649740458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:33.966748 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee5e15-0946-42d1-a8c9-a0a649740458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:33.968189 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee5e15-0946-42d1-a8c9-a0a649740458 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:33.977976 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 550/1110] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:22:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:22:43.585306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=33 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:22:43.973348 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=33 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:23:47.865201 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ceb5b-4f74-4cbd-8152-8be02eadfdfa None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:47.865850 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ceb5b-4f74-4cbd-8152-8be02eadfdfa None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:47.865850 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ceb5b-4f74-4cbd-8152-8be02eadfdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:47.885602 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-435ceb5b-4f74-4cbd-8152-8be02eadfdfa None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:47.886816 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-435ceb5b-4f74-4cbd-8152-8be02eadfdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:47.894684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 561/1111] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:23:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:47.903289 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062d71-c17a-4cb9-befe-73568b2b9dae None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:47.903790 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062d71-c17a-4cb9-befe-73568b2b9dae None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:47.903926 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062d71-c17a-4cb9-befe-73568b2b9dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:47.922801 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-2c062d71-c17a-4cb9-befe-73568b2b9dae None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:47.924305 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-2c062d71-c17a-4cb9-befe-73568b2b9dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:47.932594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 551/1112] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:23:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:47.937191 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ceb5b-4f74-4cbd-8152-8be02eadfdfa None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:47.947630 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ceb5b-4f74-4cbd-8152-8be02eadfdfa None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:47.952166 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:47.952758 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:47.953035 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:47.953302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:47.953939 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:23:47.954240 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:47.955257 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING py.warnings [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:23:47.955257 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: warnings.warn(msg) Aug 24 00:23:47.955257 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: Aug 24 00:23:47.956173 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:47.967989 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 562/1113] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 24 00:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:23:47.976312 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c062d71-c17a-4cb9-befe-73568b2b9dae None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:47.985560 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c062d71-c17a-4cb9-befe-73568b2b9dae None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:47.990055 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:47.992133 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:47.992422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:47.992694 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:47.993330 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:47.995101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING py.warnings [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:23:47.995101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: warnings.warn(msg) Aug 24 00:23:47.995101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: Aug 24 00:23:47.996339 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:48.026264 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 552/1114] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 00:23:47 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:23:48.030422 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:48.040713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18830fdf-99c3-4c4c-92be-371172f5e9f1 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:48.095331 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:48.095955 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.096236 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.096511 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.097122 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:48.098132 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING py.warnings [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:23:48.098132 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: warnings.warn(msg) Aug 24 00:23:48.098132 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: Aug 24 00:23:48.099335 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:48.120295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 563/1115] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:23:48 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:23:48.124404 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:48.135058 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d912f-b1a4-46fb-9e16-deba3ce80f6e admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:48.140002 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:48.140620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.140893 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.141161 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.141795 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:48.142790 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING py.warnings [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:23:48.142790 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: warnings.warn(msg) Aug 24 00:23:48.142790 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: Aug 24 00:23:48.143671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:48.157072 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 553/1116] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:23:48.161032 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:48.171470 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fac18-91d3-4240-808d-80a08bc7a595 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:48.176411 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3e16-ac9c-4482-b79c-cfa2ed9e87e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:48.177006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3e16-ac9c-4482-b79c-cfa2ed9e87e0 admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.177286 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3e16-ac9c-4482-b79c-cfa2ed9e87e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.177560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3e16-ac9c-4482-b79c-cfa2ed9e87e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.178848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c3e16-ac9c-4482-b79c-cfa2ed9e87e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:48.179950 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING py.warnings [None req-781c3e16-ac9c-4482-b79c-cfa2ed9e87e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:23:48.179950 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: warnings.warn(msg) Aug 24 00:23:48.179950 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: Aug 24 00:23:48.180841 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c3e16-ac9c-4482-b79c-cfa2ed9e87e0 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:48.194953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 564/1117] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:23:48.199232 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:48.209215 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c976c50-1cb2-44ca-ab50-3f5ebf7d0211 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:48.213904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500fbfa-01df-4bf4-8b61-ce3be2f3f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:48.214538 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500fbfa-01df-4bf4-8b61-ce3be2f3f6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.214812 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500fbfa-01df-4bf4-8b61-ce3be2f3f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.215082 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500fbfa-01df-4bf4-8b61-ce3be2f3f6d5 admin admin] PATH_INFO: `/v3/projects/fda704871366410f95f4d093fc52a501/users/93e9d3bee0c24a58895065459fb6afda/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.229676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500fbfa-01df-4bf4-8b61-ce3be2f3f6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda704871366410f95f4d093fc52a501, user_id=93e9d3bee0c24a58895065459fb6afda, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:48.230723 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING py.warnings [None req-c500fbfa-01df-4bf4-8b61-ce3be2f3f6d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:23:48.230723 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: warnings.warn(msg) Aug 24 00:23:48.230723 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: Aug 24 00:23:48.232736 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500fbfa-01df-4bf4-8b61-ce3be2f3f6d5 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:48.246772 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 554/1118] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 00:23:48 2022] PUT /identity/v3/projects/fda704871366410f95f4d093fc52a501/users/93e9d3bee0c24a58895065459fb6afda/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:23:48.259808 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1864b6d-82ee-4004-b978-82c981a923d4 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.260159 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1864b6d-82ee-4004-b978-82c981a923d4 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.260435 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1864b6d-82ee-4004-b978-82c981a923d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.287505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e1864b6d-82ee-4004-b978-82c981a923d4 None None] MFA Rules not processed for user `93e9d3bee0c24a58895065459fb6afda`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:48.288757 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e1864b6d-82ee-4004-b978-82c981a923d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:48.351489 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 565/1119] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:23:48 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:48.367208 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745aec-2971-4b1b-ae71-2cdf6dcec7da None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.367502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745aec-2971-4b1b-ae71-2cdf6dcec7da None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.367783 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745aec-2971-4b1b-ae71-2cdf6dcec7da None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.369153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 555/1120] 10.222.0.70 () {54 vars in 964 bytes} [Wed Aug 24 00:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:23:48.374022 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4afa-2435-4f2f-9b8f-ffe0f79bb475 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.374316 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4afa-2435-4f2f-9b8f-ffe0f79bb475 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.374596 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4afa-2435-4f2f-9b8f-ffe0f79bb475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.395684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-492c4afa-2435-4f2f-9b8f-ffe0f79bb475 None None] MFA Rules not processed for user `5c0f0416eaed4d8eaa78daa33fcf06b9`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:48.396939 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-492c4afa-2435-4f2f-9b8f-ffe0f79bb475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:48.439922 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:23:48.448648 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 566/1121] 10.222.0.70 () {58 vars in 1061 bytes} [Wed Aug 24 00:23:48 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:23:48.456301 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745aec-2971-4b1b-ae71-2cdf6dcec7da None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:48.467380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745aec-2971-4b1b-ae71-2cdf6dcec7da None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:48.470917 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f65c-a47f-40a6-a746-09d182cf95d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0416eaed4d8eaa78daa33fcf06b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:48.471511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f65c-a47f-40a6-a746-09d182cf95d4 service cinder] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.471791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f65c-a47f-40a6-a746-09d182cf95d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.472104 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f65c-a47f-40a6-a746-09d182cf95d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.481156 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076f65c-a47f-40a6-a746-09d182cf95d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:48.482580 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076f65c-a47f-40a6-a746-09d182cf95d4 service cinder] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:48.492176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 556/1122] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:23:48 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:23:48.530148 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f179-859a-46e9-8e7a-142a875f0450 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.530437 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f179-859a-46e9-8e7a-142a875f0450 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.530712 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f179-859a-46e9-8e7a-142a875f0450 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.532038 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 567/1123] 10.222.0.70 () {52 vars in 830 bytes} [Wed Aug 24 00:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:23:48.535706 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f65c-a47f-40a6-a746-09d182cf95d4 service cinder] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:48.596519 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f65c-a47f-40a6-a746-09d182cf95d4 service cinder] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:48.601708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:48.602311 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.602584 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.602851 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] PATH_INFO: `/v3/users/93e9d3bee0c24a58895065459fb6afda` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.603999 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e9d3bee0c24a58895065459fb6afda)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:48.604997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING py.warnings [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:23:48.604997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: warnings.warn(msg) Aug 24 00:23:48.604997 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: Aug 24 00:23:48.606257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:48.672075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e9d3bee0c24a58895065459fb6afda'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:48.686775 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e9d3bee0c24a58895065459fb6afda'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:48.687556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e9d3bee0c24a58895065459fb6afda'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:48.688259 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e9d3bee0c24a58895065459fb6afda'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:48.699681 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e9d3bee0c24a58895065459fb6afda'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:48.728449 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 557/1124] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 00:23:48 2022] DELETE /identity/v3/users/93e9d3bee0c24a58895065459fb6afda => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:23:48.732883 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa16dc-78dd-42d6-8847-7dcce0e81815 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.733168 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa16dc-78dd-42d6-8847-7dcce0e81815 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.733452 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa16dc-78dd-42d6-8847-7dcce0e81815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.752381 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-1aaa16dc-78dd-42d6-8847-7dcce0e81815 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:48.753501 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-1aaa16dc-78dd-42d6-8847-7dcce0e81815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:48.811374 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 568/1125] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:23:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:48.821317 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:48.822697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:48.828137 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:23:48.882346 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127773c-ac4d-4aa3-a6ab-83c396795737 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:48.885960 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c41fc-3f7c-4c17-94ac-eb30f513095e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:48.886559 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c41fc-3f7c-4c17-94ac-eb30f513095e service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:48.886836 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c41fc-3f7c-4c17-94ac-eb30f513095e service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:48.887113 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c41fc-3f7c-4c17-94ac-eb30f513095e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:48.895989 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c41fc-3f7c-4c17-94ac-eb30f513095e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:48.897515 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c41fc-3f7c-4c17-94ac-eb30f513095e service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:48.906676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 558/1126] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:23:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:23:49.436916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa16dc-78dd-42d6-8847-7dcce0e81815 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:49.438442 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-1aaa16dc-78dd-42d6-8847-7dcce0e81815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:49.451133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa16dc-78dd-42d6-8847-7dcce0e81815 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:49.455674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:49.456334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:49.456639 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:49.456977 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] PATH_INFO: `/v3/projects/fda704871366410f95f4d093fc52a501` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:49.457958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda704871366410f95f4d093fc52a501)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:49.458981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING py.warnings [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:23:49.458981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: warnings.warn(msg) Aug 24 00:23:49.458981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: Aug 24 00:23:49.460949 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:49.535618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda704871366410f95f4d093fc52a501', 'request_id': 'req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:49.548973 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda704871366410f95f4d093fc52a501', 'request_id': 'req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:49.555254 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda704871366410f95f4d093fc52a501', 'request_id': 'req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:49.570171 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] The token cache is being invalidate because project fda704871366410f95f4d093fc52a501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:23:49.570457 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:49.571161 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-ee9b357b-59b4-4b7c-a358-91aeb40e7b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:23:49.572674 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 569/1127] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 00:23:49 2022] DELETE /identity/v3/projects/fda704871366410f95f4d093fc52a501 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:23:58.902643 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=25 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:23:59.566445 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:14.164983 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daaafc-f665-4780-af38-808400818ca2 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:14.165581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daaafc-f665-4780-af38-808400818ca2 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:14.165581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daaafc-f665-4780-af38-808400818ca2 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:14.166881 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 559/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:14.172190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5485c1-d88f-462d-9e27-ea09b8d532fd None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:14.172665 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5485c1-d88f-462d-9e27-ea09b8d532fd None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:14.172777 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5485c1-d88f-462d-9e27-ea09b8d532fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:14.240690 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-fc5485c1-d88f-462d-9e27-ea09b8d532fd None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:14.241911 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-fc5485c1-d88f-462d-9e27-ea09b8d532fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:14.333019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 570/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:25:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:14.494868 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daaafc-f665-4780-af38-808400818ca2 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:14.496794 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-86daaafc-f665-4780-af38-808400818ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:14.585245 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daaafc-f665-4780-af38-808400818ca2 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:14.590692 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c190aa-a0fc-4159-abf7-362a0bbe4a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:14.591286 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c190aa-a0fc-4159-abf7-362a0bbe4a8a service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:14.591565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c190aa-a0fc-4159-abf7-362a0bbe4a8a service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:14.591858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c190aa-a0fc-4159-abf7-362a0bbe4a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:14.599815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c190aa-a0fc-4159-abf7-362a0bbe4a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:14.601408 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c190aa-a0fc-4159-abf7-362a0bbe4a8a service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:14.611499 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 560/1130] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:15.451506 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c591405-6a86-4e6f-8cfe-6f46c90b89eb None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:15.452100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c591405-6a86-4e6f-8cfe-6f46c90b89eb None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:15.452100 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c591405-6a86-4e6f-8cfe-6f46c90b89eb None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:15.453398 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 571/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:15.458231 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7152c-1793-4e18-abec-47bbd5c865ae None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:15.458743 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7152c-1793-4e18-abec-47bbd5c865ae None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:15.458856 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7152c-1793-4e18-abec-47bbd5c865ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:15.478426 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-9ee7152c-1793-4e18-abec-47bbd5c865ae None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:15.480142 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-9ee7152c-1793-4e18-abec-47bbd5c865ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:15.488051 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 561/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:25:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:15.645921 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c591405-6a86-4e6f-8cfe-6f46c90b89eb None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:15.659318 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c591405-6a86-4e6f-8cfe-6f46c90b89eb None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:15.664339 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4397707-3aa2-4a5a-b8f0-e34cf0812ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:15.664928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4397707-3aa2-4a5a-b8f0-e34cf0812ca5 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:15.665234 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4397707-3aa2-4a5a-b8f0-e34cf0812ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:15.665504 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4397707-3aa2-4a5a-b8f0-e34cf0812ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:15.674537 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4397707-3aa2-4a5a-b8f0-e34cf0812ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:15.676155 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4397707-3aa2-4a5a-b8f0-e34cf0812ca5 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:15.686397 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 572/1133] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:20.514733 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00312b3-ceea-491c-b620-5d6fc12a4c22 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:20.515252 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00312b3-ceea-491c-b620-5d6fc12a4c22 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:20.515369 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00312b3-ceea-491c-b620-5d6fc12a4c22 None None] PATH_INFO: `/v3` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:20.516604 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 562/1134] 10.222.0.18 () {54 vars in 925 bytes} [Wed Aug 24 00:25:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:25:20.522988 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f92e33-6951-4582-8c9c-0cefb6ba9c56 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:20.523404 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f92e33-6951-4582-8c9c-0cefb6ba9c56 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:20.523518 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f92e33-6951-4582-8c9c-0cefb6ba9c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:20.555597 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-79f92e33-6951-4582-8c9c-0cefb6ba9c56 None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:20.556823 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-79f92e33-6951-4582-8c9c-0cefb6ba9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:20.610665 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:20.620638 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 573/1135] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 24 00:25:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:24.698061 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baa988-1166-413d-8e68-8db3007f660d None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:24.698606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baa988-1166-413d-8e68-8db3007f660d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:24.698606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baa988-1166-413d-8e68-8db3007f660d None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:24.700589 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 563/1136] 10.222.0.70 () {54 vars in 961 bytes} [Wed Aug 24 00:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:24.705564 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75380f25-2b42-45c6-b1e0-ee35629d56ec None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:24.705958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75380f25-2b42-45c6-b1e0-ee35629d56ec None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:24.706107 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75380f25-2b42-45c6-b1e0-ee35629d56ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:24.725547 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-75380f25-2b42-45c6-b1e0-ee35629d56ec None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:24.726749 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-75380f25-2b42-45c6-b1e0-ee35629d56ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:24.735813 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 574/1137] 10.222.0.70 () {58 vars in 1058 bytes} [Wed Aug 24 00:25:24 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:24.742969 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baa988-1166-413d-8e68-8db3007f660d None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:24.756845 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baa988-1166-413d-8e68-8db3007f660d None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:24.761651 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a169bd-6ea5-451b-b8ae-34e0a4c95776 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dbddc103734eae8a975b8940d84394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:24.762902 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a169bd-6ea5-451b-b8ae-34e0a4c95776 service placement] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:24.763343 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a169bd-6ea5-451b-b8ae-34e0a4c95776 service placement] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:24.763616 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a169bd-6ea5-451b-b8ae-34e0a4c95776 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:24.771819 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a169bd-6ea5-451b-b8ae-34e0a4c95776 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:24.773409 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a169bd-6ea5-451b-b8ae-34e0a4c95776 service placement] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:24.783115 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 564/1138] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:24 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:26.942249 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850b839-8722-4f72-aff2-00bea84cd03a None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:26.942848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850b839-8722-4f72-aff2-00bea84cd03a None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:26.942848 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850b839-8722-4f72-aff2-00bea84cd03a None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:26.944153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:26.948790 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7043-ebed-4105-9ff0-4c6d5294abe4 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:26.949252 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7043-ebed-4105-9ff0-4c6d5294abe4 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:26.949399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7043-ebed-4105-9ff0-4c6d5294abe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:26.968738 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-430e7043-ebed-4105-9ff0-4c6d5294abe4 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:26.969933 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-430e7043-ebed-4105-9ff0-4c6d5294abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:26.977610 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:25:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:27.138782 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850b839-8722-4f72-aff2-00bea84cd03a None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:27.152539 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850b839-8722-4f72-aff2-00bea84cd03a None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:27.157516 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca31f5-8f73-42cf-8910-0c31ec822609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:27.158103 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca31f5-8f73-42cf-8910-0c31ec822609 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.158380 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca31f5-8f73-42cf-8910-0c31ec822609 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.158652 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca31f5-8f73-42cf-8910-0c31ec822609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.166783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca31f5-8f73-42cf-8910-0c31ec822609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:27.168942 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca31f5-8f73-42cf-8910-0c31ec822609 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:27.178718 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 576/1141] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:28.009692 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bfad-8e8f-4b10-a337-6473edc873b8 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:28.010247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bfad-8e8f-4b10-a337-6473edc873b8 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:28.010247 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bfad-8e8f-4b10-a337-6473edc873b8 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:28.011584 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 566/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:28.016889 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c34ad-216a-4085-ab5a-2d849318ea84 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:28.017346 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c34ad-216a-4085-ab5a-2d849318ea84 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:28.017443 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c34ad-216a-4085-ab5a-2d849318ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:28.040105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e89c34ad-216a-4085-ab5a-2d849318ea84 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:28.041327 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e89c34ad-216a-4085-ab5a-2d849318ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:28.050786 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 577/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:25:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:28.210546 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bfad-8e8f-4b10-a337-6473edc873b8 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:28.224709 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bfad-8e8f-4b10-a337-6473edc873b8 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:28.229556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f780d8-807b-402e-b7bf-0284ab3cbbff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:28.230136 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f780d8-807b-402e-b7bf-0284ab3cbbff service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:28.230411 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f780d8-807b-402e-b7bf-0284ab3cbbff service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:28.230683 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f780d8-807b-402e-b7bf-0284ab3cbbff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:28.239120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f780d8-807b-402e-b7bf-0284ab3cbbff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:28.240706 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f780d8-807b-402e-b7bf-0284ab3cbbff service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:28.250078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 567/1144] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:32.260203 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458c9e7-78d4-4fea-9fbf-7d90e6cd0946 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:32.260832 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458c9e7-78d4-4fea-9fbf-7d90e6cd0946 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:32.260832 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458c9e7-78d4-4fea-9fbf-7d90e6cd0946 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:32.262051 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:32.267621 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9b75-c207-4bb7-86f0-a54694917f8e None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:32.268097 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9b75-c207-4bb7-86f0-a54694917f8e None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:32.268251 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9b75-c207-4bb7-86f0-a54694917f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:32.287675 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-852f9b75-c207-4bb7-86f0-a54694917f8e None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:32.288979 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-852f9b75-c207-4bb7-86f0-a54694917f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:32.297409 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:25:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:32.648831 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458c9e7-78d4-4fea-9fbf-7d90e6cd0946 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:32.650534 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-4458c9e7-78d4-4fea-9fbf-7d90e6cd0946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:32.710552 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458c9e7-78d4-4fea-9fbf-7d90e6cd0946 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:32.714188 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04e06-c013-4a9a-82b1-2810d53af61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:32.714792 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04e06-c013-4a9a-82b1-2810d53af61b service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:32.715068 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04e06-c013-4a9a-82b1-2810d53af61b service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:32.715361 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04e06-c013-4a9a-82b1-2810d53af61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:32.724334 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04e06-c013-4a9a-82b1-2810d53af61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:32.725802 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04e06-c013-4a9a-82b1-2810d53af61b service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:32.735884 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 579/1147] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:34.955399 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245544f-b303-4fa8-abb9-06dfb50d8809 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:34.956004 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245544f-b303-4fa8-abb9-06dfb50d8809 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:34.956004 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245544f-b303-4fa8-abb9-06dfb50d8809 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:34.957308 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 569/1148] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:34.962675 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8385-2286-471e-a531-d46e1cc68f01 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:34.963107 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8385-2286-471e-a531-d46e1cc68f01 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:34.963214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8385-2286-471e-a531-d46e1cc68f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:34.983594 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-5c5c8385-2286-471e-a531-d46e1cc68f01 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:34.984815 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-5c5c8385-2286-471e-a531-d46e1cc68f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:34.994687 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 580/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:25:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:35.340062 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245544f-b303-4fa8-abb9-06dfb50d8809 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:35.351047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245544f-b303-4fa8-abb9-06dfb50d8809 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:35.354542 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9f30-d289-4496-abda-2d427c882bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:35.355126 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9f30-d289-4496-abda-2d427c882bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:35.355402 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9f30-d289-4496-abda-2d427c882bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:35.355671 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9f30-d289-4496-abda-2d427c882bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:35.364533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9f30-d289-4496-abda-2d427c882bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:35.365964 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9f30-d289-4496-abda-2d427c882bc4 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:35.376226 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 570/1150] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:39.136271 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0b8d-5724-49ae-9d05-1d17c80c2833 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:39.136837 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0b8d-5724-49ae-9d05-1d17c80c2833 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:39.136837 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0b8d-5724-49ae-9d05-1d17c80c2833 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:39.138173 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 581/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:39.144268 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a726c9-3eea-4460-b80f-75d8494aee30 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:39.144707 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a726c9-3eea-4460-b80f-75d8494aee30 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:39.144814 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a726c9-3eea-4460-b80f-75d8494aee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:39.153141 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=67 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:39.166190 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-26a726c9-3eea-4460-b80f-75d8494aee30 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:39.167388 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-26a726c9-3eea-4460-b80f-75d8494aee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:39.175501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 571/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:25:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:39.765907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c0b8d-5724-49ae-9d05-1d17c80c2833 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:39.767614 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-dd0c0b8d-5724-49ae-9d05-1d17c80c2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:39.824331 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c0b8d-5724-49ae-9d05-1d17c80c2833 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:39.828533 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f752d-0416-43fb-97fc-c0c26de0d9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0416eaed4d8eaa78daa33fcf06b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:39.829125 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f752d-0416-43fb-97fc-c0c26de0d9bc service cinder] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:39.829402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f752d-0416-43fb-97fc-c0c26de0d9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:39.829673 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f752d-0416-43fb-97fc-c0c26de0d9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:39.838473 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f752d-0416-43fb-97fc-c0c26de0d9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:39.839922 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f752d-0416-43fb-97fc-c0c26de0d9bc service cinder] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:39.849230 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 582/1153] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:42.099020 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc415aa-9acd-4083-b7c3-e55846ca97ec None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:42.099594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc415aa-9acd-4083-b7c3-e55846ca97ec None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:42.099594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc415aa-9acd-4083-b7c3-e55846ca97ec None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:42.100960 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 572/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:42.106120 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e45b-1606-4f62-8b25-8c41cf0a04d8 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:42.106548 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e45b-1606-4f62-8b25-8c41cf0a04d8 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:42.106672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e45b-1606-4f62-8b25-8c41cf0a04d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:42.127067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-bbc1e45b-1606-4f62-8b25-8c41cf0a04d8 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:42.128303 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-bbc1e45b-1606-4f62-8b25-8c41cf0a04d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:42.136283 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 583/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:25:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:42.713528 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc415aa-9acd-4083-b7c3-e55846ca97ec None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:42.715235 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-bbc415aa-9acd-4083-b7c3-e55846ca97ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:42.728445 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc415aa-9acd-4083-b7c3-e55846ca97ec None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:42.732063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50325fe4-6196-4cb2-8237-9dcf6d0d1e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0416eaed4d8eaa78daa33fcf06b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:42.732697 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50325fe4-6196-4cb2-8237-9dcf6d0d1e48 service cinder] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:42.732969 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50325fe4-6196-4cb2-8237-9dcf6d0d1e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:42.733240 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50325fe4-6196-4cb2-8237-9dcf6d0d1e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:42.741961 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50325fe4-6196-4cb2-8237-9dcf6d0d1e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:42.743408 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50325fe4-6196-4cb2-8237-9dcf6d0d1e48 service cinder] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:42.753294 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 573/1156] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:52.121258 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=70 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:52.750045 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=8 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:26:57.163910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f236ac-3743-4c67-a23e-e0c0736ba479 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.164588 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f236ac-3743-4c67-a23e-e0c0736ba479 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.164588 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f236ac-3743-4c67-a23e-e0c0736ba479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.167071 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22467c9-d4aa-4153-96c2-09b4023318a3 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.167502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22467c9-d4aa-4153-96c2-09b4023318a3 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.167608 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22467c9-d4aa-4153-96c2-09b4023318a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.184928 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-75f236ac-3743-4c67-a23e-e0c0736ba479 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:26:57.187184 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-c22467c9-d4aa-4153-96c2-09b4023318a3 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:26:57.196773 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-c22467c9-d4aa-4153-96c2-09b4023318a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:26:57.196907 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-75f236ac-3743-4c67-a23e-e0c0736ba479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:26:57.204870 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 584/1157] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:26:57.205030 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 574/1158] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:26:57.213121 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d5fa-1e61-4539-928c-5959af6316e3 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.213366 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea20b4-cf23-4c3d-937e-6f0b9347f61d None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.213477 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d5fa-1e61-4539-928c-5959af6316e3 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.213572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea20b4-cf23-4c3d-937e-6f0b9347f61d None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.213667 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d5fa-1e61-4539-928c-5959af6316e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.213764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea20b4-cf23-4c3d-937e-6f0b9347f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.234213 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-56ea20b4-cf23-4c3d-937e-6f0b9347f61d None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:26:57.234430 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-e370d5fa-1e61-4539-928c-5959af6316e3 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:26:57.235428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-56ea20b4-cf23-4c3d-937e-6f0b9347f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:26:57.235545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-e370d5fa-1e61-4539-928c-5959af6316e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:26:57.243380 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 585/1160] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:26:57.243593 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 575/1160] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:26:57.247794 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea20b4-cf23-4c3d-937e-6f0b9347f61d None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.248110 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370d5fa-1e61-4539-928c-5959af6316e3 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.256859 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea20b4-cf23-4c3d-937e-6f0b9347f61d None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.257150 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370d5fa-1e61-4539-928c-5959af6316e3 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.261793 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.261938 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.262385 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.262502 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.262664 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.263345 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.263493 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.263633 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] PATH_INFO: `/v3/domains` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.264102 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:26:57.264226 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:26:57.264403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.264505 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.265532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING py.warnings [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:26:57.265532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: warnings.warn(msg) Aug 24 00:26:57.265532 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: Aug 24 00:26:57.266142 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.266371 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.278280 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 586/1161] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 24 00:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:26:57.278511 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 576/1162] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 24 00:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:26:57.286845 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.286984 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.296959 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b705be-150b-4573-9959-127536e5eaa0 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.297095 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab48a7-9dd3-4987-9d0b-97177f862964 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.301765 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda97c-3552-4661-a305-62d1d3e17ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.301910 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.302355 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.302465 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda97c-3552-4661-a305-62d1d3e17ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.302631 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda97c-3552-4661-a305-62d1d3e17ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.302724 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.302904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda97c-3552-4661-a305-62d1d3e17ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.303006 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.303514 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda97c-3552-4661-a305-62d1d3e17ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.303618 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.304611 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING py.warnings [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:26:57.304611 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: warnings.warn(msg) Aug 24 00:26:57.304611 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: Aug 24 00:26:57.305452 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda97c-3552-4661-a305-62d1d3e17ec0 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.305799 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.347483 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 577/1163] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:26:57.351875 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 587/1164] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:26:57.352063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda97c-3552-4661-a305-62d1d3e17ec0 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.354223 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.415406 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda97c-3552-4661-a305-62d1d3e17ec0 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.415675 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526e41-54a9-4080-bc54-f2f3c0eda075 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.420044 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.420406 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e69b0-d5e2-4d70-aebb-6e61d44afd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.420642 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.420922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.421024 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e69b0-d5e2-4d70-aebb-6e61d44afd8d admin admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.421262 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e69b0-d5e2-4d70-aebb-6e61d44afd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.421379 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.421534 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e69b0-d5e2-4d70-aebb-6e61d44afd8d admin admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.421910 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.422144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e69b0-d5e2-4d70-aebb-6e61d44afd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.423179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING py.warnings [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:26:57.423179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: warnings.warn(msg) Aug 24 00:26:57.423179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: Aug 24 00:26:57.424351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e69b0-d5e2-4d70-aebb-6e61d44afd8d admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.424463 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.445754 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 578/1165] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:26:57.449875 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.450139 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 588/1166] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:26:57.454635 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e69b0-d5e2-4d70-aebb-6e61d44afd8d admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.460364 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988eef-4283-4d87-8a64-8d9533f14e16 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.464484 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e69b0-d5e2-4d70-aebb-6e61d44afd8d admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.465005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbb755-f6e5-4144-8011-609b2ffa491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.465654 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbb755-f6e5-4144-8011-609b2ffa491a admin admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.465980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbb755-f6e5-4144-8011-609b2ffa491a admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.466768 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbb755-f6e5-4144-8011-609b2ffa491a admin admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.467465 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbb755-f6e5-4144-8011-609b2ffa491a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.469029 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbb755-f6e5-4144-8011-609b2ffa491a admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.470109 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98ba9d-5127-4919-919b-83424aab6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.470699 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ba9d-5127-4919-919b-83424aab6106 admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.470979 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ba9d-5127-4919-919b-83424aab6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.471366 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ba9d-5127-4919-919b-83424aab6106 admin admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.472048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98ba9d-5127-4919-919b-83424aab6106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.473641 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98ba9d-5127-4919-919b-83424aab6106 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.480350 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 579/1167] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:26:57.484279 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbb755-f6e5-4144-8011-609b2ffa491a admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.491288 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 589/1168] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:26:57.492292 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98ba9d-5127-4919-919b-83424aab6106 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.494017 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbb755-f6e5-4144-8011-609b2ffa491a admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.498599 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4274c-2b2f-4918-b4fa-e51c785d7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.499179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4274c-2b2f-4918-b4fa-e51c785d7aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.499460 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4274c-2b2f-4918-b4fa-e51c785d7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.499735 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4274c-2b2f-4918-b4fa-e51c785d7aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.500416 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4274c-2b2f-4918-b4fa-e51c785d7aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.501992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4274c-2b2f-4918-b4fa-e51c785d7aa9 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.502164 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98ba9d-5127-4919-919b-83424aab6106 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.506755 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bd7cd-5c35-4f6e-b6a8-0bcad6b281d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.507340 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bd7cd-5c35-4f6e-b6a8-0bcad6b281d9 admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.507623 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bd7cd-5c35-4f6e-b6a8-0bcad6b281d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.507930 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bd7cd-5c35-4f6e-b6a8-0bcad6b281d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.508567 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bd7cd-5c35-4f6e-b6a8-0bcad6b281d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.510144 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bd7cd-5c35-4f6e-b6a8-0bcad6b281d9 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.513320 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 580/1169] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:26:57.517161 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4274c-2b2f-4918-b4fa-e51c785d7aa9 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.525443 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 590/1170] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:26:57.526392 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bd7cd-5c35-4f6e-b6a8-0bcad6b281d9 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.526766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4274c-2b2f-4918-b4fa-e51c785d7aa9 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.532122 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efadc04-abd9-4305-bc94-b06b029fd2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.532755 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efadc04-abd9-4305-bc94-b06b029fd2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.533036 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efadc04-abd9-4305-bc94-b06b029fd2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.533307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efadc04-abd9-4305-bc94-b06b029fd2ed admin admin] PATH_INFO: `/v3/projects/18d47d2c6025493d95d76d077c460fc5/users/1d1cb1c26d104b6791e50d0fc408b58a/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.536550 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bd7cd-5c35-4f6e-b6a8-0bcad6b281d9 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.541141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cec6f-d871-4982-9c8e-78dee2f39b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.541771 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cec6f-d871-4982-9c8e-78dee2f39b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.542048 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cec6f-d871-4982-9c8e-78dee2f39b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.542317 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cec6f-d871-4982-9c8e-78dee2f39b3e admin admin] PATH_INFO: `/v3/projects/fde0a84359644bbf90fdf5b2a940a01f/users/7b597dc3994c419690afb2c0de64b8d6/roles/811019b55bad4d3982f2f845fd434eb4` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.547890 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efadc04-abd9-4305-bc94-b06b029fd2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d47d2c6025493d95d76d077c460fc5, user_id=1d1cb1c26d104b6791e50d0fc408b58a, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.550552 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efadc04-abd9-4305-bc94-b06b029fd2ed admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.557455 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cec6f-d871-4982-9c8e-78dee2f39b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde0a84359644bbf90fdf5b2a940a01f, user_id=7b597dc3994c419690afb2c0de64b8d6, role_id=811019b55bad4d3982f2f845fd434eb4)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.558560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING py.warnings [None req-ca9cec6f-d871-4982-9c8e-78dee2f39b3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:26:57.558560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: warnings.warn(msg) Aug 24 00:26:57.558560 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: Aug 24 00:26:57.560576 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cec6f-d871-4982-9c8e-78dee2f39b3e admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.564328 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 581/1171] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 00:26:57 2022] PUT /identity/v3/projects/18d47d2c6025493d95d76d077c460fc5/users/1d1cb1c26d104b6791e50d0fc408b58a/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:26:57.570049 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3453d8-8f92-4f88-9e3d-8bdb90ad50d7 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.570341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3453d8-8f92-4f88-9e3d-8bdb90ad50d7 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.570619 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3453d8-8f92-4f88-9e3d-8bdb90ad50d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.573506 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 591/1172] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 00:26:57 2022] PUT /identity/v3/projects/fde0a84359644bbf90fdf5b2a940a01f/users/7b597dc3994c419690afb2c0de64b8d6/roles/811019b55bad4d3982f2f845fd434eb4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:26:57.578724 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2667f-00d4-43dc-ad9d-020247665683 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.579011 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2667f-00d4-43dc-ad9d-020247665683 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.579286 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2667f-00d4-43dc-ad9d-020247665683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.589674 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-9a3453d8-8f92-4f88-9e3d-8bdb90ad50d7 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:26:57.591007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-9a3453d8-8f92-4f88-9e3d-8bdb90ad50d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:26:57.598243 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-dfa2667f-00d4-43dc-ad9d-020247665683 None None] MFA Rules not processed for user `d01b5a2be47a4a399c58e609908b5598`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:26:57.599416 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-dfa2667f-00d4-43dc-ad9d-020247665683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:26:57.634823 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:26:57.647083 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:26:57.655263 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 582/1173] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:26:57.666061 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3453d8-8f92-4f88-9e3d-8bdb90ad50d7 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.666706 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 592/1174] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:26:57.677190 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2667f-00d4-43dc-ad9d-020247665683 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:57.724506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3453d8-8f92-4f88-9e3d-8bdb90ad50d7 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.728086 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333501-8484-4c84-87e6-71f665e65a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.728683 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333501-8484-4c84-87e6-71f665e65a57 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.728960 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333501-8484-4c84-87e6-71f665e65a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.729226 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333501-8484-4c84-87e6-71f665e65a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.732463 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2667f-00d4-43dc-ad9d-020247665683 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:57.736051 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd29a5-8ebd-4b64-a4fd-a43ee1275b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:57.736647 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd29a5-8ebd-4b64-a4fd-a43ee1275b65 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:57.736923 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd29a5-8ebd-4b64-a4fd-a43ee1275b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:57.737251 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd29a5-8ebd-4b64-a4fd-a43ee1275b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:57.738921 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09333501-8484-4c84-87e6-71f665e65a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.740398 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09333501-8484-4c84-87e6-71f665e65a57 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.748200 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd29a5-8ebd-4b64-a4fd-a43ee1275b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:57.749695 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd29a5-8ebd-4b64-a4fd-a43ee1275b65 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:57.750581 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 583/1175] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:26:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:26:57.759520 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 593/1176] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:26:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:27:03.077165 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d366-98ea-43be-85eb-55298db2742f None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:03.078620 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d366-98ea-43be-85eb-55298db2742f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:03.078825 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d366-98ea-43be-85eb-55298db2742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:03.124607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-ec18d366-98ea-43be-85eb-55298db2742f None None] MFA Rules not processed for user `1d1cb1c26d104b6791e50d0fc408b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:03.126839 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-ec18d366-98ea-43be-85eb-55298db2742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:03.233723 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 584/1177] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:27:03 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:03.235183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd29a5-8ebd-4b64-a4fd-a43ee1275b65 service neutron] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:03.254809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd29a5-8ebd-4b64-a4fd-a43ee1275b65 service neutron] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:03.274550 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9ddb-c810-4adc-9891-2453287219fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:03.276274 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9ddb-c810-4adc-9891-2453287219fc admin admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:03.277295 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9ddb-c810-4adc-9891-2453287219fc admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:03.278338 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9ddb-c810-4adc-9891-2453287219fc admin admin] PATH_INFO: `/v3/projects` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:03.279027 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b9ddb-c810-4adc-9891-2453287219fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:03.281120 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b9ddb-c810-4adc-9891-2453287219fc admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:03.339421 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 594/1178] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 00:27:03 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:27:03.344465 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18d366-98ea-43be-85eb-55298db2742f None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:03.367099 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18d366-98ea-43be-85eb-55298db2742f None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:03.458179 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b401-e568-440a-9dd5-da17adb864f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:03.459191 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b401-e568-440a-9dd5-da17adb864f3 admin admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:03.459675 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b401-e568-440a-9dd5-da17adb864f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:03.460275 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b401-e568-440a-9dd5-da17adb864f3 admin admin] PATH_INFO: `/v3/users` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:03.461108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24b401-e568-440a-9dd5-da17adb864f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:03.463276 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24b401-e568-440a-9dd5-da17adb864f3 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:03.508096 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9ddb-c810-4adc-9891-2453287219fc admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:03.509035 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 585/1179] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:27:03 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:27:03.526433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9ddb-c810-4adc-9891-2453287219fc admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:03.536231 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2191b4f-2f97-4871-9073-a1cb0980972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:03.540603 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191b4f-2f97-4871-9073-a1cb0980972d admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:03.541505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191b4f-2f97-4871-9073-a1cb0980972d admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:03.542057 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2191b4f-2f97-4871-9073-a1cb0980972d admin admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:03.543013 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2191b4f-2f97-4871-9073-a1cb0980972d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:03.545561 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2191b4f-2f97-4871-9073-a1cb0980972d admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:03.562766 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b401-e568-440a-9dd5-da17adb864f3 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:03.563044 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 595/1180] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:27:03.583089 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b401-e568-440a-9dd5-da17adb864f3 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:03.595097 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd2f6-97a1-44c8-8948-671af0407435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:03.595918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd2f6-97a1-44c8-8948-671af0407435 admin admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:03.596422 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd2f6-97a1-44c8-8948-671af0407435 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:03.596843 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd2f6-97a1-44c8-8948-671af0407435 admin admin] PATH_INFO: `/v3/projects/249667b9b7de4504960ad2d8500311af/users/3fe826bf1219479ab5882aeb6828061d/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:03.600722 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:03.621064 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afd2f6-97a1-44c8-8948-671af0407435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249667b9b7de4504960ad2d8500311af, user_id=3fe826bf1219479ab5882aeb6828061d, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:03.625356 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afd2f6-97a1-44c8-8948-671af0407435 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:03.648253 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 586/1181] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 00:27:03 2022] PUT /identity/v3/projects/249667b9b7de4504960ad2d8500311af/users/3fe826bf1219479ab5882aeb6828061d/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:27:03.652340 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2191b4f-2f97-4871-9073-a1cb0980972d admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:03.663697 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2191b4f-2f97-4871-9073-a1cb0980972d admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:03.764753 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b768a3-5878-42c5-87db-1786bf790481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:03.765392 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b768a3-5878-42c5-87db-1786bf790481 admin admin] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:03.765671 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b768a3-5878-42c5-87db-1786bf790481 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:03.765944 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b768a3-5878-42c5-87db-1786bf790481 admin admin] PATH_INFO: `/v3/roles` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:03.766606 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b768a3-5878-42c5-87db-1786bf790481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:03.768250 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b768a3-5878-42c5-87db-1786bf790481 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:03.786752 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 596/1182] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:27:03.790815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd2f6-97a1-44c8-8948-671af0407435 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:03.812249 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd2f6-97a1-44c8-8948-671af0407435 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:03.821467 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fdea8-2cde-4b48-aff6-de3516e30420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:03.822579 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdea8-2cde-4b48-aff6-de3516e30420 admin admin] REQUEST_METHOD: `PUT` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:03.823071 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdea8-2cde-4b48-aff6-de3516e30420 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:03.823720 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdea8-2cde-4b48-aff6-de3516e30420 admin admin] PATH_INFO: `/v3/projects/249667b9b7de4504960ad2d8500311af/users/3fe826bf1219479ab5882aeb6828061d/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:03.827326 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fdea8-2cde-4b48-aff6-de3516e30420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249667b9b7de4504960ad2d8500311af, user_id=3fe826bf1219479ab5882aeb6828061d, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:03.831342 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fdea8-2cde-4b48-aff6-de3516e30420 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:03.848090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 587/1183] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 00:27:03 2022] PUT /identity/v3/projects/249667b9b7de4504960ad2d8500311af/users/3fe826bf1219479ab5882aeb6828061d/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:27:04.013829 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690491ec-128f-4cf7-8905-738369c47b0b None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:04.015083 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690491ec-128f-4cf7-8905-738369c47b0b None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:04.015653 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690491ec-128f-4cf7-8905-738369c47b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:04.078965 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-690491ec-128f-4cf7-8905-738369c47b0b None None] MFA Rules not processed for user `7b597dc3994c419690afb2c0de64b8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:04.080493 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-690491ec-128f-4cf7-8905-738369c47b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:04.142614 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:04.179241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 597/1184] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:27:04 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:04.183425 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fdea8-2cde-4b48-aff6-de3516e30420 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:04.322056 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fdea8-2cde-4b48-aff6-de3516e30420 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:04.341313 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d978f8-6f45-4b93-bafb-1696741bd1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:04.342235 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d978f8-6f45-4b93-bafb-1696741bd1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:04.342572 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d978f8-6f45-4b93-bafb-1696741bd1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:04.342853 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d978f8-6f45-4b93-bafb-1696741bd1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:04.343524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d978f8-6f45-4b93-bafb-1696741bd1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:04.352858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d978f8-6f45-4b93-bafb-1696741bd1d2 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:04.397797 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 588/1185] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 00:27:04 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:27:04.401308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690491ec-128f-4cf7-8905-738369c47b0b None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:04.419682 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690491ec-128f-4cf7-8905-738369c47b0b None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:04.515962 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68cd3-3aa6-4dc6-bc7c-09601cfdf835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:04.516582 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68cd3-3aa6-4dc6-bc7c-09601cfdf835 admin admin] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:04.516866 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68cd3-3aa6-4dc6-bc7c-09601cfdf835 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:04.517141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68cd3-3aa6-4dc6-bc7c-09601cfdf835 admin admin] PATH_INFO: `/v3/users` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:04.517773 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce68cd3-3aa6-4dc6-bc7c-09601cfdf835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:04.520140 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce68cd3-3aa6-4dc6-bc7c-09601cfdf835 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:04.552315 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 598/1186] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 00:27:04 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:27:04.553626 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d978f8-6f45-4b93-bafb-1696741bd1d2 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:04.565606 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d978f8-6f45-4b93-bafb-1696741bd1d2 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:04.570547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8240da0-4368-4956-a5f0-aee101251190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:04.571217 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8240da0-4368-4956-a5f0-aee101251190 admin admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:04.571428 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8240da0-4368-4956-a5f0-aee101251190 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:04.571678 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8240da0-4368-4956-a5f0-aee101251190 admin admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:04.572427 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8240da0-4368-4956-a5f0-aee101251190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:04.574195 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8240da0-4368-4956-a5f0-aee101251190 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:04.592899 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68cd3-3aa6-4dc6-bc7c-09601cfdf835 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:04.593929 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 589/1187] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:27:04.607684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68cd3-3aa6-4dc6-bc7c-09601cfdf835 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:04.613995 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d86987-36a3-4db8-acb2-d8c851ea2695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:04.615019 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d86987-36a3-4db8-acb2-d8c851ea2695 admin admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:04.615325 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d86987-36a3-4db8-acb2-d8c851ea2695 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:04.615594 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d86987-36a3-4db8-acb2-d8c851ea2695 admin admin] PATH_INFO: `/v3/projects/5414ad5623344f22845fba97dca3efa0/users/e0c82c8def214de284860b48955d75b4/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:04.642351 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d86987-36a3-4db8-acb2-d8c851ea2695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5414ad5623344f22845fba97dca3efa0, user_id=e0c82c8def214de284860b48955d75b4, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:04.645308 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d86987-36a3-4db8-acb2-d8c851ea2695 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:04.667517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 599/1188] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 00:27:04 2022] PUT /identity/v3/projects/5414ad5623344f22845fba97dca3efa0/users/e0c82c8def214de284860b48955d75b4/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:27:04.673031 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8240da0-4368-4956-a5f0-aee101251190 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:04.694007 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8240da0-4368-4956-a5f0-aee101251190 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:04.828269 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486fc36-9d80-4fa2-9334-24528c401ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:04.828990 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486fc36-9d80-4fa2-9334-24528c401ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:04.829390 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486fc36-9d80-4fa2-9334-24528c401ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:04.832527 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486fc36-9d80-4fa2-9334-24528c401ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:04.833257 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486fc36-9d80-4fa2-9334-24528c401ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:04.835055 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486fc36-9d80-4fa2-9334-24528c401ca9 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:04.846780 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 590/1189] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 00:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:27:04.850757 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d86987-36a3-4db8-acb2-d8c851ea2695 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:04.867286 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d86987-36a3-4db8-acb2-d8c851ea2695 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:04.873083 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:04.873852 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:04.874139 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:04.874398 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] PATH_INFO: `/v3/projects/5414ad5623344f22845fba97dca3efa0/users/e0c82c8def214de284860b48955d75b4/roles/952eea31fada4104858d315ac0f1296a` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:04.876593 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5414ad5623344f22845fba97dca3efa0, user_id=e0c82c8def214de284860b48955d75b4, role_id=952eea31fada4104858d315ac0f1296a)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:04.879347 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:04.894807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 600/1190] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 00:27:04 2022] PUT /identity/v3/projects/5414ad5623344f22845fba97dca3efa0/users/e0c82c8def214de284860b48955d75b4/roles/952eea31fada4104858d315ac0f1296a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:27:09.952269 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11f74-c6bf-4516-85a1-d35aaa5c044a None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:09.952822 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11f74-c6bf-4516-85a1-d35aaa5c044a None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:09.952822 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11f74-c6bf-4516-85a1-d35aaa5c044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:10.020735 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-dfd11f74-c6bf-4516-85a1-d35aaa5c044a None None] MFA Rules not processed for user `3fe826bf1219479ab5882aeb6828061d`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:10.025702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-dfd11f74-c6bf-4516-85a1-d35aaa5c044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:10.101134 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:10.210493 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 591/1191] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:27:09 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:10.224269 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:10.226769 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:10.355200 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bcaa8-ae0b-4c06-8e4d-b6feead1a4ff admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:10.370579 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e31af0d7f814b0b86140be2c2d64f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:10.371110 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:10.371556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:10.372012 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:10.496143 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:10.542554 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:10.544868 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:10.567000 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 601/1192] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:10 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:11.050487 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920c95-8686-45b4-9609-dfa8181ab266 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:11.050977 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920c95-8686-45b4-9609-dfa8181ab266 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:11.051063 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920c95-8686-45b4-9609-dfa8181ab266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:11.096594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-25920c95-8686-45b4-9609-dfa8181ab266 None None] MFA Rules not processed for user `e0c82c8def214de284860b48955d75b4`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:11.098359 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-25920c95-8686-45b4-9609-dfa8181ab266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:11.225310 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 592/1193] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:27:11 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:11.239302 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:11.240796 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:11.257933 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dad5a-f6ba-4587-a094-6ebe3e6d4a3d service glance] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:11.269448 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b253985-a667-402a-be8f-a074a87fc7de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e31af0d7f814b0b86140be2c2d64f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:11.271067 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b253985-a667-402a-be8f-a074a87fc7de service glance] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:11.272603 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b253985-a667-402a-be8f-a074a87fc7de service glance] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:11.274776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b253985-a667-402a-be8f-a074a87fc7de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:11.413905 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b253985-a667-402a-be8f-a074a87fc7de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:11.415623 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b253985-a667-402a-be8f-a074a87fc7de service glance] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:11.427819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 602/1194] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:11 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:19.833185 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f204-8bfb-4ea7-8a8e-65c8fee573c2 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:19.833738 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f204-8bfb-4ea7-8a8e-65c8fee573c2 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:19.834301 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f204-8bfb-4ea7-8a8e-65c8fee573c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:19.864933 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f7d0f204-8bfb-4ea7-8a8e-65c8fee573c2 None None] MFA Rules not processed for user `7b597dc3994c419690afb2c0de64b8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:19.867338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f7d0f204-8bfb-4ea7-8a8e-65c8fee573c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:19.877002 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 593/1195] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:27:19 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:20.180012 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3365185-a3b2-48d9-8e6f-3948f0dcd7c1 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:20.181184 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3365185-a3b2-48d9-8e6f-3948f0dcd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:20.181634 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3365185-a3b2-48d9-8e6f-3948f0dcd7c1 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:20.185857 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 603/1196] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 24 00:27:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:27:20.201009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8995-0e44-40a5-811d-c03878ce4235 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:20.201808 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8995-0e44-40a5-811d-c03878ce4235 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:20.202927 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8995-0e44-40a5-811d-c03878ce4235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:20.236800 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-9cae8995-0e44-40a5-811d-c03878ce4235 None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:20.238369 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-9cae8995-0e44-40a5-811d-c03878ce4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:20.312176 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 594/1197] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 24 00:27:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:20.329546 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257f16-0508-4eb5-800d-8edb612d3c07 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:20.331474 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257f16-0508-4eb5-800d-8edb612d3c07 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:20.331900 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257f16-0508-4eb5-800d-8edb612d3c07 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:20.333556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 604/1198] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 24 00:27:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:27:20.341067 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830a4d-a41e-4ba8-8601-cf1f4ae53e30 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:20.341355 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830a4d-a41e-4ba8-8601-cf1f4ae53e30 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:20.341633 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830a4d-a41e-4ba8-8601-cf1f4ae53e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:20.368818 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-f2830a4d-a41e-4ba8-8601-cf1f4ae53e30 None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:20.370073 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-f2830a4d-a41e-4ba8-8601-cf1f4ae53e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:20.380078 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 595/1199] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 24 00:27:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:20.392525 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d257f16-0508-4eb5-800d-8edb612d3c07 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:20.405668 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d257f16-0508-4eb5-800d-8edb612d3c07 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:20.410104 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905799d-75e3-44de-9afe-e6cf63e7274a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e31af0d7f814b0b86140be2c2d64f2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:20.411369 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905799d-75e3-44de-9afe-e6cf63e7274a service glance] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:20.411872 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905799d-75e3-44de-9afe-e6cf63e7274a service glance] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:20.412352 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905799d-75e3-44de-9afe-e6cf63e7274a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:20.425879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905799d-75e3-44de-9afe-e6cf63e7274a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:20.427761 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905799d-75e3-44de-9afe-e6cf63e7274a service glance] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:20.441163 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 605/1200] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:20.960996 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed41c-a6ec-4027-b5bd-d343a3ed9bd0 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:20.961570 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed41c-a6ec-4027-b5bd-d343a3ed9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:20.962108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed41c-a6ec-4027-b5bd-d343a3ed9bd0 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:20.964996 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 596/1201] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 24 00:27:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:27:20.971305 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac23e84-8b1c-4073-9f5b-cc1f6ddf7c6e None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:20.971590 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac23e84-8b1c-4073-9f5b-cc1f6ddf7c6e None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:20.971897 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac23e84-8b1c-4073-9f5b-cc1f6ddf7c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:21.017748 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-fac23e84-8b1c-4073-9f5b-cc1f6ddf7c6e None None] MFA Rules not processed for user `0c2c8ea12b814b0f9abaaa2a2b8cd3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:21.022851 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-fac23e84-8b1c-4073-9f5b-cc1f6ddf7c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:21.086036 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 606/1202] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 24 00:27:20 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:21.097098 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeed41c-a6ec-4027-b5bd-d343a3ed9bd0 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:21.098759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-ceeed41c-a6ec-4027-b5bd-d343a3ed9bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:21.111605 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeed41c-a6ec-4027-b5bd-d343a3ed9bd0 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:21.115075 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84cf2e-89dc-4074-91f3-b5698d13fe61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:21.115663 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cf2e-89dc-4074-91f3-b5698d13fe61 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:21.116047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cf2e-89dc-4074-91f3-b5698d13fe61 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:21.116325 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cf2e-89dc-4074-91f3-b5698d13fe61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:21.124732 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84cf2e-89dc-4074-91f3-b5698d13fe61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:21.126187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84cf2e-89dc-4074-91f3-b5698d13fe61 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:21.134293 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 597/1203] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:21 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:21.596749 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac23e84-8b1c-4073-9f5b-cc1f6ddf7c6e None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:21.605918 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc66f3-dfcf-4beb-b29b-19c9c6929a14 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:21.606457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc66f3-dfcf-4beb-b29b-19c9c6929a14 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:21.606841 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc66f3-dfcf-4beb-b29b-19c9c6929a14 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:21.608719 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 598/1204] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 24 00:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:27:21.618029 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba745-1d3b-465b-8ce0-1c576498c416 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:21.618584 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba745-1d3b-465b-8ce0-1c576498c416 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:21.619095 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba745-1d3b-465b-8ce0-1c576498c416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:21.661103 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-6feba745-1d3b-465b-8ce0-1c576498c416 None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:21.663611 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-6feba745-1d3b-465b-8ce0-1c576498c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:21.677323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 599/1205] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 24 00:27:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:27:21.683021 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252ec2-aca7-4d4e-8534-3dc02c8083af None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:21.683440 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252ec2-aca7-4d4e-8534-3dc02c8083af None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:21.684591 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252ec2-aca7-4d4e-8534-3dc02c8083af None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:21.686813 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 600/1206] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 24 00:27:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:27:21.692429 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390602be-6a6b-4783-bc1b-2d340dd54b2c None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:21.692710 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390602be-6a6b-4783-bc1b-2d340dd54b2c None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:21.693170 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390602be-6a6b-4783-bc1b-2d340dd54b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:21.694505 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=100 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:21.708268 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=100 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:21.712525 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac23e84-8b1c-4073-9f5b-cc1f6ddf7c6e None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:21.723226 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1218f-2ebe-4a6e-9b5e-972bbf41bd64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dbddc103734eae8a975b8940d84394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:21.724296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1218f-2ebe-4a6e-9b5e-972bbf41bd64 service placement] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:21.724963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1218f-2ebe-4a6e-9b5e-972bbf41bd64 service placement] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:21.725981 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1218f-2ebe-4a6e-9b5e-972bbf41bd64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:21.728210 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-390602be-6a6b-4783-bc1b-2d340dd54b2c None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:21.729640 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-25a1218f-2ebe-4a6e-9b5e-972bbf41bd64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:21.730830 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-390602be-6a6b-4783-bc1b-2d340dd54b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:21.748071 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 601/1207] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 24 00:27:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:27:21.749110 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1218f-2ebe-4a6e-9b5e-972bbf41bd64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:21.750912 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1218f-2ebe-4a6e-9b5e-972bbf41bd64 service placement] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:21.759639 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390602be-6a6b-4783-bc1b-2d340dd54b2c None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:21.777322 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390602be-6a6b-4783-bc1b-2d340dd54b2c None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:21.777765 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 607/1208] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:21 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:21.783026 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a275b-803b-43ae-845f-cda125050bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:21.783931 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a275b-803b-43ae-845f-cda125050bad service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:21.784340 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a275b-803b-43ae-845f-cda125050bad service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:21.785092 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a275b-803b-43ae-845f-cda125050bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:21.799702 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a275b-803b-43ae-845f-cda125050bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:21.808009 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a275b-803b-43ae-845f-cda125050bad service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:21.837682 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 602/1209] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:27:31.757819 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=4 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:31.826707 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=7 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:31.888543 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745d02-07fe-469b-a7b3-1dc60a4bd1bd None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:31.888825 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745d02-07fe-469b-a7b3-1dc60a4bd1bd None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:31.889124 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745d02-07fe-469b-a7b3-1dc60a4bd1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:31.912133 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-0a745d02-07fe-469b-a7b3-1dc60a4bd1bd None None] MFA Rules not processed for user `0c2c8ea12b814b0f9abaaa2a2b8cd3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:31.913391 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-0a745d02-07fe-469b-a7b3-1dc60a4bd1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:31.920307 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 608/1210] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 24 00:27:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:31.932716 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a275b-803b-43ae-845f-cda125050bad service neutron] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:31.943479 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a275b-803b-43ae-845f-cda125050bad service neutron] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:31.947163 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b75d34-87ac-477c-959d-655d8fec550a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:31.947790 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75d34-87ac-477c-959d-655d8fec550a service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:31.948105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75d34-87ac-477c-959d-655d8fec550a service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:31.948381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75d34-87ac-477c-959d-655d8fec550a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:31.956446 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b75d34-87ac-477c-959d-655d8fec550a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:31.958095 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b75d34-87ac-477c-959d-655d8fec550a service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:31.966759 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 603/1211] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:31 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:32.907377 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5381b-5635-4a9a-b488-e4517fa4d5d1 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:32.907965 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5381b-5635-4a9a-b488-e4517fa4d5d1 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:32.908117 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5381b-5635-4a9a-b488-e4517fa4d5d1 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:32.909790 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 609/1212] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 00:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:27:32.963964 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d05b-acc2-4e19-aeb9-9ff1dbcb81b1 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:32.965237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d05b-acc2-4e19-aeb9-9ff1dbcb81b1 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:32.965237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d05b-acc2-4e19-aeb9-9ff1dbcb81b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:32.989094 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-be43d05b-acc2-4e19-aeb9-9ff1dbcb81b1 None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:32.990713 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-be43d05b-acc2-4e19-aeb9-9ff1dbcb81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:33.001105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 604/1213] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 00:27:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:33.024664 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5381b-5635-4a9a-b488-e4517fa4d5d1 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:33.054131 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5381b-5635-4a9a-b488-e4517fa4d5d1 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:33.060323 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a31d-7655-4694-a7ff-016463c3ac92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:33.060942 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a31d-7655-4694-a7ff-016463c3ac92 service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:33.061220 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a31d-7655-4694-a7ff-016463c3ac92 service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:33.061493 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a31d-7655-4694-a7ff-016463c3ac92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:33.070663 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a31d-7655-4694-a7ff-016463c3ac92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:33.072289 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a31d-7655-4694-a7ff-016463c3ac92 service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:33.082659 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 610/1214] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:38.602302 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a092-5c15-4d26-acd8-29524e02a095 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:38.602922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a092-5c15-4d26-acd8-29524e02a095 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:38.602922 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a092-5c15-4d26-acd8-29524e02a095 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:38.604238 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 605/1215] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 00:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:27:38.612088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481811cf-b7c8-4fe0-bf78-535435175424 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:38.612581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481811cf-b7c8-4fe0-bf78-535435175424 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:38.612581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481811cf-b7c8-4fe0-bf78-535435175424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:38.635621 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-481811cf-b7c8-4fe0-bf78-535435175424 None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:38.637732 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-481811cf-b7c8-4fe0-bf78-535435175424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:38.647299 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 611/1216] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 00:27:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:38.669895 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a092-5c15-4d26-acd8-29524e02a095 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:38.695300 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a092-5c15-4d26-acd8-29524e02a095 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:38.700980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a440f1c-4abf-4f10-8476-367a9e76cddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:38.701940 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a440f1c-4abf-4f10-8476-367a9e76cddd service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:38.702405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a440f1c-4abf-4f10-8476-367a9e76cddd service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:38.702847 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a440f1c-4abf-4f10-8476-367a9e76cddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:38.712272 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a440f1c-4abf-4f10-8476-367a9e76cddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:38.713858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a440f1c-4abf-4f10-8476-367a9e76cddd service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:38.723953 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 606/1217] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:48.630121 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=12 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:48.719873 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=15 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:51.378112 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481811cf-b7c8-4fe0-bf78-535435175424 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:51.388966 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481811cf-b7c8-4fe0-bf78-535435175424 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:51.392911 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79193aa7-0d00-4434-a01c-59f0ad3871a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:51.393546 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79193aa7-0d00-4434-a01c-59f0ad3871a3 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:51.393827 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79193aa7-0d00-4434-a01c-59f0ad3871a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:51.394099 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79193aa7-0d00-4434-a01c-59f0ad3871a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:51.404642 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79193aa7-0d00-4434-a01c-59f0ad3871a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:51.406131 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79193aa7-0d00-4434-a01c-59f0ad3871a3 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:51.424202 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 612/1218] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:51 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:27:53.556350 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a2e93-2943-411e-a743-9a78c0839024 None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:53.556887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a2e93-2943-411e-a743-9a78c0839024 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:53.556887 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a2e93-2943-411e-a743-9a78c0839024 None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:53.558827 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 607/1219] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 00:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:27:53.564241 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd75a1-5a45-4ddd-ac6f-9cd4ffcd1098 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:53.564730 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd75a1-5a45-4ddd-ac6f-9cd4ffcd1098 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:53.567896 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd75a1-5a45-4ddd-ac6f-9cd4ffcd1098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:53.602386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-80cd75a1-5a45-4ddd-ac6f-9cd4ffcd1098 None None] MFA Rules not processed for user `d8c2ac1eccaf4ffd88d49b119da41cae`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:53.604632 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-80cd75a1-5a45-4ddd-ac6f-9cd4ffcd1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:53.614630 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 613/1220] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 00:27:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:53.643818 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a2e93-2943-411e-a743-9a78c0839024 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:53.660266 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a2e93-2943-411e-a743-9a78c0839024 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:53.666419 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0cb27-ee4d-449c-9037-af81ba7f25e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:53.668113 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0cb27-ee4d-449c-9037-af81ba7f25e3 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:53.668565 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0cb27-ee4d-449c-9037-af81ba7f25e3 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:53.669013 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0cb27-ee4d-449c-9037-af81ba7f25e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:53.679202 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0cb27-ee4d-449c-9037-af81ba7f25e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:53.681180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0cb27-ee4d-449c-9037-af81ba7f25e3 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:53.692544 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 608/1221] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:28:03.593707 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=9 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:28:03.688125 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=6 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:28:10.736383 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305844-75f2-4417-b0b9-9e35ec73a153 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:28:10.736953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305844-75f2-4417-b0b9-9e35ec73a153 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:28:10.736953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305844-75f2-4417-b0b9-9e35ec73a153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:28:10.755390 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-b5305844-75f2-4417-b0b9-9e35ec73a153 None None] MFA Rules not processed for user `1d1cb1c26d104b6791e50d0fc408b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:28:10.756672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b5305844-75f2-4417-b0b9-9e35ec73a153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:28:10.763554 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 614/1222] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:28:10 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:28:11.257307 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60288a7b-f9f0-4527-be0d-6c42aa2867c0 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:28:11.257936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60288a7b-f9f0-4527-be0d-6c42aa2867c0 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:28:11.257936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60288a7b-f9f0-4527-be0d-6c42aa2867c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:28:11.276676 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-60288a7b-f9f0-4527-be0d-6c42aa2867c0 None None] MFA Rules not processed for user `0c2c8ea12b814b0f9abaaa2a2b8cd3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:28:11.277877 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-60288a7b-f9f0-4527-be0d-6c42aa2867c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:28:11.284321 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 609/1223] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 24 00:28:11 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:28:11.295869 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5305844-75f2-4417-b0b9-9e35ec73a153 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:28:11.305545 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5305844-75f2-4417-b0b9-9e35ec73a153 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:28:11.309870 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093c1f4-648a-4ed8-919d-20c6c0719000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:28:11.310466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093c1f4-648a-4ed8-919d-20c6c0719000 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:28:11.310743 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093c1f4-648a-4ed8-919d-20c6c0719000 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:28:11.311012 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093c1f4-648a-4ed8-919d-20c6c0719000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:28:11.318109 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093c1f4-648a-4ed8-919d-20c6c0719000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:28:11.319541 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093c1f4-648a-4ed8-919d-20c6c0719000 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:28:11.327398 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 615/1224] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:28:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:28:21.271883 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:28:21.324381 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=9 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:28:36.033842 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460eb2a-70d0-4d89-9e01-8cdf2449db1f None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:28:36.034316 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460eb2a-70d0-4d89-9e01-8cdf2449db1f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:28:36.034404 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460eb2a-70d0-4d89-9e01-8cdf2449db1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:28:36.053121 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-a460eb2a-70d0-4d89-9e01-8cdf2449db1f None None] MFA Rules not processed for user `1d1cb1c26d104b6791e50d0fc408b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:28:36.054339 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-a460eb2a-70d0-4d89-9e01-8cdf2449db1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:28:36.061291 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 610/1225] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:28:36 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:28:46.048102 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:28:49.522994 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e64229-abfe-4930-9edf-f692934021b2 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:28:49.523433 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e64229-abfe-4930-9edf-f692934021b2 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:28:49.523535 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e64229-abfe-4930-9edf-f692934021b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:28:49.542953 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-84e64229-abfe-4930-9edf-f692934021b2 None None] MFA Rules not processed for user `1d1cb1c26d104b6791e50d0fc408b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:28:49.544189 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-84e64229-abfe-4930-9edf-f692934021b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:28:49.552054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 616/1226] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:28:49 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:28:59.538226 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=3 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:29:47.564105 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23289ee-8901-4c63-ab89-507170958388 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:29:47.564645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23289ee-8901-4c63-ab89-507170958388 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:29:47.564645 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23289ee-8901-4c63-ab89-507170958388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:29:47.583948 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-e23289ee-8901-4c63-ab89-507170958388 None None] MFA Rules not processed for user `1d1cb1c26d104b6791e50d0fc408b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:29:47.585139 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-e23289ee-8901-4c63-ab89-507170958388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:29:47.591775 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 611/1227] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:29:47 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:29:57.578258 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=3 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:29:59.289661 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e64229-abfe-4930-9edf-f692934021b2 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:29:59.309424 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e64229-abfe-4930-9edf-f692934021b2 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:29:59.312960 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cf44-2a5c-43a8-8948-bc594bdbc494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:29:59.313556 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cf44-2a5c-43a8-8948-bc594bdbc494 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:29:59.313835 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cf44-2a5c-43a8-8948-bc594bdbc494 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:29:59.314104 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cf44-2a5c-43a8-8948-bc594bdbc494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:29:59.323613 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8cf44-2a5c-43a8-8948-bc594bdbc494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:29:59.325155 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8cf44-2a5c-43a8-8948-bc594bdbc494 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:29:59.335077 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 617/1228] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:29:59 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:30:09.330529 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=10 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:30:27.750669 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23289ee-8901-4c63-ab89-507170958388 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:30:27.773432 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23289ee-8901-4c63-ab89-507170958388 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:30:27.778421 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df1990-7b70-410d-9823-2c3eba8bb432 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dbddc103734eae8a975b8940d84394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:30:27.779017 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df1990-7b70-410d-9823-2c3eba8bb432 service placement] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:30:27.779380 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df1990-7b70-410d-9823-2c3eba8bb432 service placement] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:30:27.779594 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df1990-7b70-410d-9823-2c3eba8bb432 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:30:27.789533 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df1990-7b70-410d-9823-2c3eba8bb432 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:30:27.790567 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df1990-7b70-410d-9823-2c3eba8bb432 service placement] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:30:27.801180 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 612/1229] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:30:27 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:30:37.796630 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=10 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:31:48.341688 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44cba-f141-4256-ab28-ea91997e44e6 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:31:48.342192 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44cba-f141-4256-ab28-ea91997e44e6 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:31:48.342298 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44cba-f141-4256-ab28-ea91997e44e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:31:48.360968 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-42d44cba-f141-4256-ab28-ea91997e44e6 None None] MFA Rules not processed for user `7b597dc3994c419690afb2c0de64b8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:31:48.362163 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-42d44cba-f141-4256-ab28-ea91997e44e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:31:48.369024 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 618/1230] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:31:48 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:31:58.356250 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=3 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:10.156016 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df1990-7b70-410d-9823-2c3eba8bb432 service placement] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:10.188509 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df1990-7b70-410d-9823-2c3eba8bb432 service placement] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:10.195167 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac2dca-7a52-4147-a346-888a29822cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:10.195980 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac2dca-7a52-4147-a346-888a29822cf4 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:10.197417 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac2dca-7a52-4147-a346-888a29822cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:10.198122 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac2dca-7a52-4147-a346-888a29822cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:10.211315 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac2dca-7a52-4147-a346-888a29822cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:10.213464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac2dca-7a52-4147-a346-888a29822cf4 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:10.226215 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 613/1231] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:10 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:11.265267 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44cba-f141-4256-ab28-ea91997e44e6 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:11.334347 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44cba-f141-4256-ab28-ea91997e44e6 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:11.338908 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1eaad-2eff-4411-a696-28045825873b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0416eaed4d8eaa78daa33fcf06b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:11.339517 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1eaad-2eff-4411-a696-28045825873b service cinder] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:11.339793 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1eaad-2eff-4411-a696-28045825873b service cinder] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:11.340092 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1eaad-2eff-4411-a696-28045825873b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:11.353493 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1eaad-2eff-4411-a696-28045825873b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:11.355322 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1eaad-2eff-4411-a696-28045825873b service cinder] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:11.376086 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 619/1232] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:11 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:11.404641 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1c9a-8ac0-4187-b630-2b6f785905b6 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:11.405108 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1c9a-8ac0-4187-b630-2b6f785905b6 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:11.405419 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1c9a-8ac0-4187-b630-2b6f785905b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:11.428458 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-0ace1c9a-8ac0-4187-b630-2b6f785905b6 None None] MFA Rules not processed for user `1d1cb1c26d104b6791e50d0fc408b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:32:11.430152 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-0ace1c9a-8ac0-4187-b630-2b6f785905b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:11.439524 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 614/1233] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:32:11 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:32:20.847809 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1eaad-2eff-4411-a696-28045825873b service cinder] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:20.857725 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1eaad-2eff-4411-a696-28045825873b service cinder] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:20.861246 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d705-2a66-4184-8c92-b8244bb09776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:20.861832 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d705-2a66-4184-8c92-b8244bb09776 service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:20.862103 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d705-2a66-4184-8c92-b8244bb09776 service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:20.862368 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d705-2a66-4184-8c92-b8244bb09776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:20.872037 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4d705-2a66-4184-8c92-b8244bb09776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:20.873398 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4d705-2a66-4184-8c92-b8244bb09776 service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:20.883254 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 620/1234] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:21.422547 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=13 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:22.068944 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace1c9a-8ac0-4187-b630-2b6f785905b6 None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:22.078221 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace1c9a-8ac0-4187-b630-2b6f785905b6 None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:22.081776 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736aad-8618-43f0-89c5-790529dfeb6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:22.082510 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736aad-8618-43f0-89c5-790529dfeb6f service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:22.082705 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736aad-8618-43f0-89c5-790529dfeb6f service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:22.082942 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736aad-8618-43f0-89c5-790529dfeb6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:22.093668 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736aad-8618-43f0-89c5-790529dfeb6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:22.095094 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736aad-8618-43f0-89c5-790529dfeb6f service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:22.106160 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 615/1235] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:30.878969 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=36 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:32.101153 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=6 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:41.235684 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d705-2a66-4184-8c92-b8244bb09776 service neutron] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:41.248927 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d705-2a66-4184-8c92-b8244bb09776 service neutron] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:41.253581 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347cf31-662e-45d9-b5a3-79f9e24ab5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:41.254240 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347cf31-662e-45d9-b5a3-79f9e24ab5df service neutron] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:41.254561 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347cf31-662e-45d9-b5a3-79f9e24ab5df service neutron] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:41.254902 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347cf31-662e-45d9-b5a3-79f9e24ab5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:41.263871 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347cf31-662e-45d9-b5a3-79f9e24ab5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:41.265479 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347cf31-662e-45d9-b5a3-79f9e24ab5df service neutron] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:41.275911 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 621/1236] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:41 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:51.271987 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=6 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:33:26.666580 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736aad-8618-43f0-89c5-790529dfeb6f service neutron] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:26.678791 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736aad-8618-43f0-89c5-790529dfeb6f service neutron] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:26.684161 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228d1b5-c719-41b1-ba9d-c4d4f859d086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:26.684764 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228d1b5-c719-41b1-ba9d-c4d4f859d086 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:26.685047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228d1b5-c719-41b1-ba9d-c4d4f859d086 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:26.685325 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228d1b5-c719-41b1-ba9d-c4d4f859d086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:26.696673 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228d1b5-c719-41b1-ba9d-c4d4f859d086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:26.698299 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228d1b5-c719-41b1-ba9d-c4d4f859d086 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:26.728206 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 616/1237] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:33:26 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:33:27.802275 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347cf31-662e-45d9-b5a3-79f9e24ab5df service neutron] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:27.817088 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347cf31-662e-45d9-b5a3-79f9e24ab5df service neutron] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:27.833489 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6dc4f-fc03-40fc-8637-0000ca9df77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:27.834214 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6dc4f-fc03-40fc-8637-0000ca9df77b service nova] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:27.834554 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6dc4f-fc03-40fc-8637-0000ca9df77b service nova] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:27.834932 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6dc4f-fc03-40fc-8637-0000ca9df77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:27.845146 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6dc4f-fc03-40fc-8637-0000ca9df77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:27.846974 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6dc4f-fc03-40fc-8637-0000ca9df77b service nova] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:27.858885 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 622/1238] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:33:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:33:34.579907 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228d1b5-c719-41b1-ba9d-c4d4f859d086 service nova] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:34.588936 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228d1b5-c719-41b1-ba9d-c4d4f859d086 service nova] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:34.593171 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b83d9-17d6-4929-9bd4-66b37986376e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:34.593758 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b83d9-17d6-4929-9bd4-66b37986376e service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:34.594040 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b83d9-17d6-4929-9bd4-66b37986376e service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:34.594314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b83d9-17d6-4929-9bd4-66b37986376e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:34.655120 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b83d9-17d6-4929-9bd4-66b37986376e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:34.656578 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b83d9-17d6-4929-9bd4-66b37986376e service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:34.676554 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 617/1239] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:33:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:33:37.855110 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=6 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:33:38.002807 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c80c8-9aa6-4e5e-beb5-426419c29393 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:38.003223 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c80c8-9aa6-4e5e-beb5-426419c29393 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:38.003604 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c80c8-9aa6-4e5e-beb5-426419c29393 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:38.005168 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 623/1240] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 00:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:33:38.034636 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab961ee-618e-4022-9d26-34d7c4d189d8 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:38.035133 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab961ee-618e-4022-9d26-34d7c4d189d8 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:38.035220 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab961ee-618e-4022-9d26-34d7c4d189d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:38.122438 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-cab961ee-618e-4022-9d26-34d7c4d189d8 None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:33:38.123724 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-cab961ee-618e-4022-9d26-34d7c4d189d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:33:38.132419 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 618/1241] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 00:33:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:33:38.143742 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84cd9-72a4-47c4-81e7-1dc3bb26daa7 None None] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:38.144087 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84cd9-72a4-47c4-81e7-1dc3bb26daa7 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:38.144366 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84cd9-72a4-47c4-81e7-1dc3bb26daa7 None None] PATH_INFO: `/` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:38.145680 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 624/1242] 10.222.0.70 () {54 vars in 961 bytes} [Wed Aug 24 00:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:33:38.150872 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34496-5ed4-47e0-b165-e4b4c2a410b2 None None] REQUEST_METHOD: `POST` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:38.151237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34496-5ed4-47e0-b165-e4b4c2a410b2 None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:38.151617 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34496-5ed4-47e0-b165-e4b4c2a410b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:38.174109 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.auth.core [None req-52d34496-5ed4-47e0-b165-e4b4c2a410b2 None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:33:38.175341 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-52d34496-5ed4-47e0-b165-e4b4c2a410b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:33:38.185338 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 619/1243] 10.222.0.70 () {58 vars in 1058 bytes} [Wed Aug 24 00:33:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:33:38.193153 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f84cd9-72a4-47c4-81e7-1dc3bb26daa7 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:38.206986 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f84cd9-72a4-47c4-81e7-1dc3bb26daa7 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:38.212004 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55906e-7977-4221-8b8a-ddd96f36c0f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dbddc103734eae8a975b8940d84394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:38.212657 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55906e-7977-4221-8b8a-ddd96f36c0f1 service placement] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:38.212879 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55906e-7977-4221-8b8a-ddd96f36c0f1 service placement] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:38.213151 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55906e-7977-4221-8b8a-ddd96f36c0f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:38.222679 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55906e-7977-4221-8b8a-ddd96f36c0f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:38.224313 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55906e-7977-4221-8b8a-ddd96f36c0f1 service placement] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:38.234915 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 625/1244] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:33:38 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:33:41.336516 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065af05-e700-4fc9-96b9-f3370733054f None None] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:41.336998 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065af05-e700-4fc9-96b9-f3370733054f None None] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:41.337116 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065af05-e700-4fc9-96b9-f3370733054f None None] PATH_INFO: `/` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:41.338450 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 620/1245] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 00:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:33:41.371916 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac55f-f235-4500-a196-ece0c73d3e82 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:41.373118 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac55f-f235-4500-a196-ece0c73d3e82 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:41.373751 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac55f-f235-4500-a196-ece0c73d3e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:41.395768 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-cd0ac55f-f235-4500-a196-ece0c73d3e82 None None] MFA Rules not processed for user `16dbddc103734eae8a975b8940d84394`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:33:41.397077 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-cd0ac55f-f235-4500-a196-ece0c73d3e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:33:41.406272 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065af05-e700-4fc9-96b9-f3370733054f None None] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:41.408021 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 626/1246] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 00:33:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:33:41.420449 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065af05-e700-4fc9-96b9-f3370733054f None None] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:41.424917 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:41.425556 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:41.425834 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:41.426106 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] PATH_INFO: `/v3/users/7b597dc3994c419690afb2c0de64b8d6` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:41.427261 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b597dc3994c419690afb2c0de64b8d6)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:41.429237 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:41.485506 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b597dc3994c419690afb2c0de64b8d6'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.492975 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b597dc3994c419690afb2c0de64b8d6'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.493728 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b597dc3994c419690afb2c0de64b8d6'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.494480 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b597dc3994c419690afb2c0de64b8d6'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.503744 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b597dc3994c419690afb2c0de64b8d6'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.518934 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:33:41.525323 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 621/1247] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 00:33:41 2022] DELETE /identity/v3/users/7b597dc3994c419690afb2c0de64b8d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:33:41.662008 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac55f-f235-4500-a196-ece0c73d3e82 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:41.672758 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac55f-f235-4500-a196-ece0c73d3e82 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:41.724501 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:41.725989 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:33:41.744057 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dbddc103734eae8a975b8940d84394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:41.744882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:41.745304 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:41.745713 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:41.748376 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:33:41.760209 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:41.761817 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:41.773296 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 627/1248] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:33:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:33:41.800846 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed69dfc-4000-4e4f-bb91-f97b359c1305 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:41.805476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:41.806101 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:41.806382 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:41.806655 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] PATH_INFO: `/v3/projects/fde0a84359644bbf90fdf5b2a940a01f` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:41.807803 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde0a84359644bbf90fdf5b2a940a01f)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:41.808976 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: WARNING py.warnings [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:33:41.808976 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: warnings.warn(msg) Aug 24 00:33:41.808976 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: Aug 24 00:33:41.810743 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:41.866658 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde0a84359644bbf90fdf5b2a940a01f', 'request_id': 'req-0a23902b-8934-416a-9f6f-a4a34cfa1f09'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.879992 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde0a84359644bbf90fdf5b2a940a01f', 'request_id': 'req-0a23902b-8934-416a-9f6f-a4a34cfa1f09'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.887660 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde0a84359644bbf90fdf5b2a940a01f', 'request_id': 'req-0a23902b-8934-416a-9f6f-a4a34cfa1f09'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.899418 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] The token cache is being invalidate because project fde0a84359644bbf90fdf5b2a940a01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:33:41.899705 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.900384 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:41.901866 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 622/1249] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 00:33:41 2022] DELETE /identity/v3/projects/fde0a84359644bbf90fdf5b2a940a01f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:33:41.906001 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:41.917672 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c6ebc-1bde-42da-b1f4-41b48329dd70 service placement] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:41.973565 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:41.974183 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:41.974457 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:41.974723 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] PATH_INFO: `/v3/users/e0c82c8def214de284860b48955d75b4` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:41.976415 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c82c8def214de284860b48955d75b4)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:41.977432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: WARNING py.warnings [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:33:41.977432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: warnings.warn(msg) Aug 24 00:33:41.977432 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: Aug 24 00:33:41.978629 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:42.039905 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c82c8def214de284860b48955d75b4'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.050790 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c82c8def214de284860b48955d75b4'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.051572 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c82c8def214de284860b48955d75b4'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.052244 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c82c8def214de284860b48955d75b4'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.069704 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:33:42.070882 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-07bbef91-5f13-4bc4-8ed6-e891a2318085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c82c8def214de284860b48955d75b4'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.085392 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 628/1250] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 00:33:41 2022] DELETE /identity/v3/users/e0c82c8def214de284860b48955d75b4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:33:42.255348 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:42.256793 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:33:42.270815 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23902b-8934-416a-9f6f-a4a34cfa1f09 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:42.343395 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:42.344065 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:42.344314 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:42.344634 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] PATH_INFO: `/v3/projects/5414ad5623344f22845fba97dca3efa0` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:42.345891 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5414ad5623344f22845fba97dca3efa0)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:42.347904 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:42.380596 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:33:42.395539 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5414ad5623344f22845fba97dca3efa0', 'request_id': 'req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.401838 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5414ad5623344f22845fba97dca3efa0', 'request_id': 'req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.410159 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5414ad5623344f22845fba97dca3efa0', 'request_id': 'req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.424437 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] The token cache is being invalidate because project 5414ad5623344f22845fba97dca3efa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:33:42.424724 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.425391 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:33:42.427845 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 623/1251] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 00:33:42 2022] DELETE /identity/v3/projects/5414ad5623344f22845fba97dca3efa0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:33:52.081762 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:33:52.417842 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:34:05.980246 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3c65-277d-42bf-8544-7a4e84c76823 None None] REQUEST_METHOD: `POST` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:34:05.980749 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3c65-277d-42bf-8544-7a4e84c76823 None None] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:34:05.980941 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3c65-277d-42bf-8544-7a4e84c76823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:34:05.999979 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.auth.core [None req-f15f3c65-277d-42bf-8544-7a4e84c76823 None None] MFA Rules not processed for user `1d1cb1c26d104b6791e50d0fc408b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=94701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:34:06.001192 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-f15f3c65-277d-42bf-8544-7a4e84c76823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:34:06.054523 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 629/1252] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 00:34:05 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:34:06.393107 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:34:06.394503 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:34:06.451952 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4a7ff-1abd-4935-b947-d11b0a063e6a admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:34:06.456195 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:34:06.456794 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:34:06.457079 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:34:06.457352 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:34:06.459061 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:34:06.468893 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:34:06.470311 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:34:06.478381 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 624/1253] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:34:06 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:34:06.926220 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3c65-277d-42bf-8544-7a4e84c76823 None None] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:34:06.929994 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-f15f3c65-277d-42bf-8544-7a4e84c76823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:34:07.002247 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3c65-277d-42bf-8544-7a4e84c76823 None None] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:34:07.007232 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dbddc103734eae8a975b8940d84394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:34:07.007883 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:34:07.008135 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:34:07.008403 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:34:07.010105 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:34:07.021381 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:34:07.022963 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:34:07.032614 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 630/1254] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:34:06 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:34:14.520464 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:34:14.522326 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:34:14.596306 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa459882-17a8-4aac-809d-a0ffa0973b61 service neutron] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:34:14.601405 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c2ac1eccaf4ffd88d49b119da41cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:34:14.602019 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:34:14.602295 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:34:14.602564 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:34:14.604353 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:34:14.616858 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:34:14.618388 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:34:14.629690 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 625/1255] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:34:14 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:34:17.028607 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=57 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:34:24.624543 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=58 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:35:33.696141 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:35:33.697569 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:33.759590 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139b044-fb4e-4b5e-9962-520068265dda service placement] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:35:33.764894 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dbddc103734eae8a975b8940d84394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:35:33.765500 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:35:33.765776 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:35:33.766044 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:35:33.767872 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:33.780434 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:35:33.782053 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:35:33.792338 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 631/1256] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:35:33 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:35:43.787734 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=28 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:36:50.756757 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:36:50.779778 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100f5de-5e74-46c4-ba12-8b484cc8f658 service nova] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:36:50.783551 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c2c8ea12b814b0f9abaaa2a2b8cd3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:36:50.784214 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] REQUEST_METHOD: `GET` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:36:50.784497 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:36:50.784774 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:36:50.786705 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:36:50.872117 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:36:50.873567 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:36:50.883368 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 626/1257] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:36:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:36:57.221853 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:36:57.223311 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:36:57.240456 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8942-98b3-45c0-a305-66b081f6318d service placement] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:36:57.245164 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:36:57.245797 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:36:57.246074 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:36:57.246401 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] PATH_INFO: `/v3/users/1d1cb1c26d104b6791e50d0fc408b58a` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:36:57.247783 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1cb1c26d104b6791e50d0fc408b58a)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:36:57.249915 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:36:57.305207 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1cb1c26d104b6791e50d0fc408b58a'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.312158 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1cb1c26d104b6791e50d0fc408b58a'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.312821 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1cb1c26d104b6791e50d0fc408b58a'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.313431 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1cb1c26d104b6791e50d0fc408b58a'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.324971 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1cb1c26d104b6791e50d0fc408b58a'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.337700 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 632/1258] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 00:36:57 2022] DELETE /identity/v3/users/1d1cb1c26d104b6791e50d0fc408b58a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:36:57.524023 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:36:57.533925 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c68ca-35c8-4c96-8315-5d41447dd570 service neutron] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:36:57.596828 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:36:57.597457 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:36:57.597741 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:36:57.598090 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] PATH_INFO: `/v3/projects/18d47d2c6025493d95d76d077c460fc5` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:36:57.608526 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d47d2c6025493d95d76d077c460fc5)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:36:57.610439 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:36:57.655484 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d47d2c6025493d95d76d077c460fc5', 'request_id': 'req-ba618435-ad52-4263-b43a-1d86ff67a302'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.662005 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d47d2c6025493d95d76d077c460fc5', 'request_id': 'req-ba618435-ad52-4263-b43a-1d86ff67a302'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.664476 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:36:57.670535 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d47d2c6025493d95d76d077c460fc5', 'request_id': 'req-ba618435-ad52-4263-b43a-1d86ff67a302'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.681607 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] The token cache is being invalidate because project 18d47d2c6025493d95d76d077c460fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:36:57.681897 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.682525 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.684047 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 627/1259] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 00:36:57 2022] DELETE /identity/v3/projects/18d47d2c6025493d95d76d077c460fc5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:36:57.688653 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:36:57.690054 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:36:57.703905 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf9923-8818-422b-9ec7-e31973d070fd admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:36:57.758402 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:36:57.759027 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:36:57.759306 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:36:57.759577 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] PATH_INFO: `/v3/users/3fe826bf1219479ab5882aeb6828061d` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:36:57.760721 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe826bf1219479ab5882aeb6828061d)` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:36:57.762665 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:36:57.815958 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe826bf1219479ab5882aeb6828061d'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.822633 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe826bf1219479ab5882aeb6828061d'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.823287 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe826bf1219479ab5882aeb6828061d'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.823913 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe826bf1219479ab5882aeb6828061d'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.836386 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.notifications [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe826bf1219479ab5882aeb6828061d'} {{(pid=94701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:57.838055 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:36:57.850016 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 633/1260] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 00:36:57 2022] DELETE /identity/v3/users/3fe826bf1219479ab5882aeb6828061d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:36:58.017818 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] Authenticating user token {{(pid=94702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:36:58.019248 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.fernet_utils [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:36:58.032057 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba618435-ad52-4263-b43a-1d86ff67a302 admin admin] Validating token access rules against request {{(pid=94702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:36:58.096419 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01b5a2be47a4a399c58e609908b5598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165c34800e2494a8f309a6e802bd8dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:36:58.097054 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:36:58.097334 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:36:58.097602 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] PATH_INFO: `/v3/projects/249667b9b7de4504960ad2d8500311af` {{(pid=94702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:36:58.098733 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249667b9b7de4504960ad2d8500311af)` {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:36:58.100710 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] RBAC: Authorization granted {{(pid=94702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:36:58.147187 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249667b9b7de4504960ad2d8500311af', 'request_id': 'req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:58.153252 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249667b9b7de4504960ad2d8500311af', 'request_id': 'req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:58.160510 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249667b9b7de4504960ad2d8500311af', 'request_id': 'req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06'} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:58.171419 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] The token cache is being invalidate because project 249667b9b7de4504960ad2d8500311af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:36:58.171708 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:58.172393 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG keystone.notifications [None req-6a387bf1-58f0-41cb-a6ba-4399cd3d6c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:36:58.173880 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: [pid: 94702|app: 0|req: 628/1261] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 00:36:58 2022] DELETE /identity/v3/projects/249667b9b7de4504960ad2d8500311af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:37:07.848102 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:37:08.168132 dv-osbrick-786733-9-ceph devstack@keystone.service[94702]: DEBUG dbcounter [-] [94702] Writing DB stats keystone:DELETE=10,keystone:SELECT=55,keystone:INSERT=1 {{(pid=94702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:40:37.673437 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] Authenticating user token {{(pid=94701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:40:37.674871 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:40:37.752837 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c2ea7-ccfd-498e-a352-c7aa7c3f4b90 admin admin] Validating token access rules against request {{(pid=94701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:40:37.812466 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84895f-a4ac-4b83-9083-958dfd2e250a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dbddc103734eae8a975b8940d84394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee46bb5a5b04e239bf1ef96355c8080', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:40:37.813073 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84895f-a4ac-4b83-9083-958dfd2e250a service placement] REQUEST_METHOD: `GET` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:40:37.813381 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84895f-a4ac-4b83-9083-958dfd2e250a service placement] SCRIPT_NAME: `/identity` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:40:37.813651 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84895f-a4ac-4b83-9083-958dfd2e250a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:40:37.815370 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.fernet_utils [None req-8f84895f-a4ac-4b83-9083-958dfd2e250a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:40:37.826828 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84895f-a4ac-4b83-9083-958dfd2e250a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:40:37.828447 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84895f-a4ac-4b83-9083-958dfd2e250a service placement] RBAC: Authorization granted {{(pid=94701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:40:37.838064 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: [pid: 94701|app: 0|req: 634/1262] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 00:40:37 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:40:47.833985 dv-osbrick-786733-9-ceph devstack@keystone.service[94701]: DEBUG dbcounter [-] [94701] Writing DB stats keystone:SELECT=62 {{(pid=94701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}